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PREFACE 


Management  Consulting  &  Research  Inc.  ( MCR )  is  providing 
support  to  the  Office  of  the  Assistant  Secretary  of  Defense 
(OASD)  for  Manpower,  Installations  and  Logistics  under  contract 
number  MDA90 3-8 2-C-O 1 6 6  for  the  examination  of  skill  training. 
MCR  reports  in  this  area  will  assist  in  the  evaluation  and 
support  of  Service  training  programs. 

This  technical  report  is  a  contract  deliverable  that  docu¬ 
ments  Service  training  and  maintenance  data  systems.  This  report 
provides  descriptions  of  system  data  elements  and  sources  of 
data,  examines  data  utility  for  analyses  of  training  and  main¬ 
tenance,  and  identifies  areas  where  improvements  could  be  made  to 
assist  in  the  analysis  of  training.  The  intent  of  the  research 
documented  in  this  report  is  to  assist  the  Defense  Training  Data 
and  Analysis  Center  ( TDAC )  ,  under  the  auspices  of  the  OASD  for 
Manpower,  Installations  and  Logistics. 

We  would  like  to  acknowledge  the  continuing  guidance  and 
assistance  of  Mr.  Gary  Boycan  of  the  Training  Policy  Directorate. 
Also,  the  review  of  our  work  by  members  of  the  TDAC  has  been 
particularly  helpful.  The  assistance  and  cooperation  of  members 
of  the  Service  staffs,  subordinate  commands,  and  unit-level  per¬ 
sonnel  is  greatly  appreciated. 


EXECUTIVE  SUMMARY 


This  summary  includes  the  study  purpose,  organization  of 
this  report,  conclusions  and  recommendations. 

A.  STUDY  PURPOSE  AND  REPORT  ORGANIZATION 

The  purpose  of  this  study  was  to  analyze  DoD-wide  unit-level 
training  and  maintenance  data  systems .  We  examined  the  operation 
of  the  Military  Services'  systems  that  document  individual  skill 
training  and  maintenance  performance.  Our  study  included  three 
tasks : 

•  analyze  unit-level  Navy  aviation  training  and  mainte¬ 
nance  data  systems, 

•  analyze  unit-level  Marine  Corps  aviation  training  and 
maintenance  data  systems,  and 

•  analyze  Army  and  Air  Force  unit-level  training  and 
maintenance  data  systems . 

This  report  contains  five  sections.  Section  I,  Introduc¬ 
tion,  describes  the  purpose,  background,  approach,  and  organiza¬ 
tion  of  this  report.  Section  II,  Air  Force  Data  Systems, 
describes  Air  Force  training  and  maintenance  data  systems. 
Section  III,  Army  Data  Systems,  describes  Army  training  and 
maintenance  data  systems.  Section  IV,  Navy  and  Marine  Corps  Data 
Systems,  describes  Navy  and  Marine  Corps  training  and  maintenance 
data  systems.  Section  V,  Conclusions  and  Recommendations, 
describes  the  conclusions  we  reached  concerning  each  Service’s 
data  systems  and  contains  some  recommendations  for  improvement . 

Exhibit  ES-1  is  a  summary  of  the  data  systems  we  examined. 
It  lists  each  system  by  name,  acronym,  control  point,  and  general 
attributes . 


B.  CONCLUSIONS  AND  RECOMMENDATIONS 


Our  study  of  Service  training  and  maintenance  data  systems 
examined  each  Service's  training  system(s)  and  maintenance  sys- 
tem(s).  We  endeavored  to  look  at  the  systems  used  at  the  unit 
level  as  well  as  overall  Service  systems;  generally,  these  were 
the  same.  We  documented  sources  of  data,  data  elements,  and 
sample  reports  for  use  in  analytical  efforts.  We  also  described 
some  of  our  analytical  approaches  and  utility  of  Service  data 
systems  for  analyses.  The  following  are  the  conclusions  and  re¬ 
commendations  we  made  concerning  the  use  of  Service  systems  for 
analytical  purposes . 

0ur  conclusion  concerning  Air  Force  training  and  maintenance 
data  systems  is  that  they  lend  themselves  readily  to  the  analysis 
of  maintenance-related  training.  We  developed  linkages  between 
training  and  maintenance  and  showed  how  such  analyses  could  be 
performed.  We  recommend  improvements  to  maintenance  data  collec¬ 
tion  that  could  benefit  the  current  system  and  assist  analysis  at 
the  wing  level.  The  first  would  be  the  entry  of  employee  number 
for  all  maintenance  crew  personnel  in  the  maintenance  data  col¬ 
lection  system.  This  would  allow  direct  and  precise  measure¬ 
ments  of  training  and  productivity  for  individuals  and  work 
centers.  A  second  improvement  would  be  a  greater  use  of  com¬ 
ponent  level  designation  for  maintenance  reporting  rather  than 
system  or  subsystem  designation.  This  would  allow  more  refined 
analyses  to  be  performed  and  would  more  precisely  define  that 
work  is  being  done. 


Our  conclusion  concerning  Army  training  and  maintenance  data 
systems  is  that  they  do  not  support  analyses  of  maintenance- 
related  training  as  currently  configured.  However,  the  Army 
central  training  data  system,  the  Army  Training  Requirements  and 
Resources  System  (ATRRS)  does  provide  some  information  which  is 
useful  for  other  analytical  purposes.  For  example.  The  Army  Pro¬ 
gram  for  Individual  Training  (ARPRINT),  which  specifies  detailed 
course  and  class  information,  can  be  used  for  comparison  with 
available  resources  by  Army  staff  agencies.  The  Military  Man¬ 
power  Training  Report  (MMTR)  input  report  is  a  particularly  use¬ 
ful  report  since  it  provides  summary  detail,  by  category  of 
training,  including  inputs,  outputs,  and  training  loads.  The 
MMTR  input  report  can  also  be  used  for  comparative  purposes  with 
available  training  resources  at  a  higher  level  of  aggregation, 
such  as  total  Army  initial  skill  training.  The  current  mainte¬ 
nance  data  base.  The  Army  Maintenance  Management  System  (TAMMS), 
does  not  provide  information  useful  for  evaluating  maintenance 
performance  related  to  individual  skill  training.  Because  the 
ability  to  identify  and  track  individuals  is  central  to  any 
methodology  for  relating  maintenance  performance  to  training, 
TAMMS  data  are  not  appropriate  for  training  analysis.  The  up¬ 
coming  Standard  Army  Maintenance  System  (SAMS)  is  also  not 
designed  for  training  analysis  purposes;  no  information  that 
identifies  individuals  is  included  in  this  system.  The  system, 
however,  is  still  in  preliminary  implementation  stages.  Data 
elements  could  be  added  to  the  system.  The  possible  inclusion  of 
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the  Army  Research  Institute  (ARI)  developed  Maintenance  Perfor¬ 
mance  System  (MPS)  within  SAMS  would  allow  training/productivity 
analyses  to  be  developed.  Even  if  individual  identification  were 
not  included  in  the  system,  the  improvements  in  accuracy  and 
level  of  detail  over  the  TAMMS  data  base  could  be  of  benefit  for 
training/productivity  analyses. 

We  do  not  have  any  specific  recommendations  concerning  Army 
data  bases.  Our  general  observation  is  that  current  Army  efforts 
may  provide  analytical  benefits  in  the  future. 

Our  conclusions  concerning  Navy  and  Marine  Corps  data  are  as 
follows : 

•  Navy  and  Marine  Corps  maintenance  data  is  centrally 
maintained,  is  easily  accessible,  and  can  be  requested 
in  usable,  standard  formats  in  support  of  analytical 
efforts . 

•  Navy  training  data  is  maintained  centrally  on  all 
course  data?  it  is  easily  accessible,  and  can  be 
requested  in  standard  report  formats.  The  files  are 
particularly  useful  in  providing  workload  data  for 
examination  of  resource  levels  (e.g.,  instructors). 
The  central  training  files  do  not  provide  individual 
training  data  —  this  must  be  obtained  at  the  installa¬ 
tion  level,  similar  to  the  Air  Force  but  with  one  main 
difference — it  is  not  automated. 

•  Marine  Corps  training  data  is  maintained  centrally  by 
the  Office  of  the  DCS  Training,  Headquarters  USMC.  The 
Training  Input  Plan  (TIP)  contains  overall  training 
loads  by  skill  area.  "Training  Tracks"  or  "pipeline" 
information  is  similarly  maintained. 

•  A  difficulty  with  examination  of  Navy  individual  train¬ 
ing  status  is  a  lack  of  consolidated  "pipeline"  in¬ 
formation  on  specific  skills.  MCR  developed  the  pipe¬ 
line  for  aviation  electronic  technicians.  Others  would 
have  to  be  developed  similarly  for  any  skill  level 
analyses . 


We  recommend  that  specific  efforts  be  undertaken  in  order  to 
improve  the  use  of  these  data  for  analytical  purposes.  These 
efforts  should  include  the  following: 

•  Establish  linkages  between  specified  skills  and  related 
maintenance  actions  for  Navy  aviation.  Once  these 
linkages  are  established,  the  resulting  information  can 
be  used  to  support  resources  for  individual  training 
and  can  be  used  to  measure  effectiveness  of  training. 

•  Build  resource  models  for  examination  of  requirements 
in  support  of  workload  for  training.  Navy  data  is 
readily  available  to  support  this  effort.  It  would 
support  the  analytical  work  and  related  budgetary  im¬ 
pact  for  OSD  and  the  TDAC . 

•  Develop  "pipelines"  for  Navy  maintenance  skills  similar 
to  the  example  developed  by  MCR.  These  pipelines  are 
needed  for  any  analyses  of  resources  for  maintenance  or 
non-maintenance  skills.  Also,  the  assessment  of  main¬ 
tenance  and  training  linkages  requires  this  same 
information.  The  necessary  information  is  available. 


C.  OBSERVATIONS 

Our  study  effort  brought  us  into  close  contact  with  Service 
users  of  the  systems  we  describe  as  well  as  made  us  aware  of  the 
intricacies  of  the  data  systems  themselves.  The  following 
comments  are  directly  related  to  our  work  and  are  included  here 
as  observations  with  no  conclusions  or  recommendations  made 
concerning  them. 

•  The  reporting  accuracy  of  the  data  in  Service 
maintenance  data  bases  has  been  questioned  by  some 
analysts.  This  comment  is  primarily  directed  at  the 
Air  Force  and  Navy  systems  since  they  allow  for  "time" 
to  be  documented  in  terms  of  workhours  expended  for 
specified  maintenance  tasks.  Also,  both  systems 
account  for  maintenance  actions  by  category  as  well  as 
on  what  subsystem/component  work  was  performed.  This 
latter  data  element  is  also  open  to  question  as  to 
accuracy  in  documentation.  No  attempt  was  made  in  our 


research  to  ascertain  the  general  accuracy  of  data 
reporting.  However,  this  matter  is  of  concern  since  it 
affects  the  use  to  which  the  data  can  be  put.  A 
general  observation  is  that  there  appears  to  be 
considerable  pressure  at  the  installation  level  to 
account  for  each  job  performed  both  in  terms  of  what 
was  done  and  how  long  it  took  to  do  it.  Similarly, 
gross  errors  are  easily  detected  and  usually  are  found 
and  corrected.  Small  errors  in  time  accounting  are 
unlikely  to  be  detected  since  there  is  no  method  for 
doing  so.  Errors  in  component  documentation  would  be 
detected  and  are  unlikely  to  occur  since  supervisors 
use  these  entries  for  a  variety  of  management  reports 
such  as  the  "high  10"  and  "high  20  "--these  are 
component  listing  reports  for  those  components  most 
prone  to  repair.  Consequently,  the  highest  error  rate 
is  probably  found  where  exact  repair  time  is  desired 
for  data  analysis.  Repair  time  is  usually  an 
approximation  based  on  start  and  finish  time,  but 
delays  due  to  awaiting  parts,  etc.  are  not  noted.  Where 
the  research  uses  a  large  number  of  work  actions,  as  in 
our  analyses,  the  average  time  of  repair  is  presumed  to 
be  a  fair  approximation.  In  summation,  the  issue  of 
whether  the  data  files  accurately  represent  what 
actually  occurs  during  maintenance  is  not  easily 
answered.  In  general,  it  appears  they  do  but  it  is 
fairly  certain  that  not  all  entries  are  correct.  Future 
analytical  work  might  focus  on  this  aspect  of  the 
system  data.  Short  of  a  physical  survey  of  relevant 
work  centers  it  is  doubtful  if  any  other  observation 
can  be  made . 

The  relationship  of  maintenance  productivity  to 
training  is  a  research  subject  that  is  addressed  in 
several  previous  reports  and  to  a  lesser  extent  in  this 
report.  Broadly  speaking,  we  defined  productivity  as 
measured  by  the  amount  of  time  in  workhours  needed  to 
complete  a  specific  maintenance  action.  This  was  an 
easy  way  to  approach  the  problem  since  the  data  systems 
specifically  provide  that  information.  Other,  more 
difficult  to  obtain,  measures  or  ones  for  which  the 
data  appeared  to  be  less  useful  were  the  use  of 
pass/fail  indicators  on  quality  assurance  inspections 
and  the  used  of  "retest  okay"  (RETOK)  data--parts 
returned  as  faulty  that  upon  further  test  (at  depot 
level)  were  found  to  be  without  fault. 
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I .  INTRODUCTION 


This  section  discusses  the  following: 

•  Purpose, 

•  Background, 

•  Approach,  and 

•  Organization  of  this  Report. 

A.  PURPOSE 

The  purpose  of  this  study  was  to  analyze  DoD-wide  unit-level 
training  and  maintenance  data  systems.  Specifically,  we  have 
documented  selected  Air  Force,  Army,  Navy,  and  Marine  Corps 
training  and  maintenance  data  systems.  The  study  consisted  of 
three  tasks: 

•  analyze  unit- level  Navy  aviation  training  and  mainte¬ 
nance  data  systems, 

•  analyze  unit-level  Marine  Corps  aviation  training  and 
maintenance  data  systems,  and 

•  analyze  Army  and  Air  Force  unit-level  training  and 
maintenance  data  systems. 

These  tasks  were  completed  by  accomplishing  the  following 
research: 

•  choosing  appropriate  organizations  for  examination  of 
supporting  data  systems, 

•  examining  maintenance  and  training  system  data  elements 
and  system  operation, 

•  describing  the  data  elements  and  sources  of  informa¬ 
tion, 

•  analyzing  data  availability  and  utility,  and 

•  identifying  those  areas  where  changes  should  be  made  to 
provide  better  or  improved  analytical  support  for  both 
Service  and  DoD-wide  usage. 


B. 


BACKGROUND 


The  Office  of  the  Secretary  of  Defense  (OSD)  has  issued 
policy  guidance  that  manpower  impacts  will  be  considered  in  sys¬ 
tem  design  and  operation.  This  consideration  requires  both  OSD 
and  the  Services  to  develop  improved  methods  for  evaluating  man¬ 
power,  personnel,  and  training.  The  analysis  of  critical  skills, 
particularly  the  impact  of  required  levels  of  maintenance  skills 
on  quality  of  maintenance,  is  a  key  factor  in  these  evaluations. 
Individuals  required  to  operate  and  maintain  weapon  systems  reach 
the  journeyman  level  through  individual  training  conducted  at  the 
installation  level. 

Due  to  a  growing  concern  for  the  problems  in  maintaining  and 
operating  existing  weapon  systems,  a  comprehensive  review  of 
training  was  initiated  by  the  OSD  Training  Directorate.  Some 
initial  work  has  been  completed  concerning  how  weapon  system  sup¬ 
port  can  be  improved  with  better  training.  In  an  earlier 
1/ 

report,  OSD  described  existing  on-the-job  training  (OJT) 

programs  and  proposed  ways  to  enhance  training,  especially  OJT, 

2/ 

xn  order  to  improve  equipment  maintenance.  Subsequently,- 
OSD  provided  an  overview  of  the  systems  developed  to  train 
individuals  in  selected  maintenance  skills.  The  latter  report 

A/  Report  on  the  OJT  Study  Task:  On  the  Job  Training  in  the 
Department  of  Defense,  OASD(MRA&L)  under  the  auspices  of  the 
Defense  Education  and  Training  Executive  Committee,  January 
1981. 

A'  Report  on  Individual  Skill  Training:  Maintenance  Training  in 
the  Department  of  Defense,  OASD(MRA&L),  May  1982. 


covers  the  entire  training  plan,  from  initial  skill  training  in 
formal  schools  to  individual  skill  training  received  at  the  unit 
level.  Based  on  these  study  efforts,  and  in  support  of  the  OSD 
Training  Directorate,  MCR  completed  an  analysis  to  develop  a 

linkage  between  individual  training  conducted  at  the  installa- 

.  •  3/ 

tion  level  and  unit  productivity.-7  Additional  research  con¬ 
centrated  on  Air  Force  F-16  unit  level  training,  maintenance  pro- 

47 

ductivity,  and  use  of  maintenance  simulators.-  The  research 
accomplished  in  our  previous  studies  provided  a  firm  basis  for 
our  current  research. 

C.  APPROACH 

MCR  studies  have  developed  information  concerning  mainte¬ 
nance  and  training  systems.  This  current  project  expands  on  our 
previous  work  by  examining  and  documenting  Air  Force,  Army,  Navy, 
and  Marine  Corps: 

•  training  data  systems, 

•  maintenance  data  collection  systems, 


3/  Rodney  D.  McConnell  et  al.  ,  Skill  Training  Analysis:  The 
Linkage  of  Unit  Level  Skill  Training  and  Unit  Productivity, 
TR-8202-1,  Volume  I,  and  Skill  Training  Analysis:  An 

Examination  of  the  Navy  Pipeline  Management  System, 
TR-82C2-1,  Volume  II,  Management  Consulting  &  Research,  Inc. , 
14  June  1983. 

4/  Rodney  D.  McConnell  and  Stuart  C.  Johnson,  Skill  Training 
Analysis — Phase  II:  The  Linkage  of  Unit  Level  Skill  Training 
and  Maintenance  Productivity  in  Air  Force  F-16  Units, 
TR-8302-1,  Management  Consulting  &  Research,  Inc.,  13  April 
1984. 


•  data  element  availability  and  utility,  and 

•  areas  for  improvement. 

D.  ORGANIZATION  OF  THIS  REPORT 

Following  this  introduction  are  four  other  sections  of  the 
report : 

•  Air  Force  Data  Systems, 

•  Army  Data  Systems, 

•  Navy  and  Marine  Corps  Data  Systems,  and 

•  Conclusions  and  Recommendations. 

Section  II,  Air  Force  Data  Systems,  discusses  the  Air  Force 
training  data  systems  and  the  Air  Force  Maintenance  Data  Collec¬ 
tion  system.  Section  III,  Army  Data  Systems,  discusses  Army 
training  data  systems  and  the  Army  maintenance  data  system. 
Section  IV,  Navy  and  Marine  Corps  Data  Systems,  discusses  the 
Navy  and  Marine  Corps  systems  for  maintaining  training  informa¬ 
tion  and  aviation  maintenance  information.  Section  V,  Conclu¬ 
sions  and  Recommendations,  discusses  the  utility  for  analyses  of 
Service  data  systems  and  recommends  specific  efforts  for  improve¬ 
ment  that  would  assist  DoD  analytical  efforts.  References  are 
provided  in  Appendix  A  and  Abbreviations  in  Appendix  B. 


II.  AIR  FORCE  DATA  SYSTEMS 

This  section  discusses  Air  Force  data  systems  that  can  pro¬ 
vide  information  for  analyses  of  training  and  related  maintenance 
effects.  The  topics  addressed  are  the  following: 

•  Air  Force  Training  Data  Systems, 

•  Air  Force  Maintenance  Data  Collection  System,  and 

•  Summary  of  Analysis. 

A.  AIR  FORCE  TRAINING  DATA  SYSTEMS 

The  Air  Force  has  two  systems  for  accounting  for  Air  Force 
training,  both  of  which  are  discussed  in  this  subsection.  The 
Maintenance  Management  Information  and  Control  System  (MMICS) 
training  subsystem  is  used  at  the  unit  level.  The  Pipeline 
Management  System  (PMS)  is  used  at  Air  Training  Command  (ATC)  for 
keeping  track  of  all  Air  Force  training. 


1 .  Unit-Level  Training  Data  System 

The  Air  Force  conducts  a  significant  amount  of  formal 
individual  technical  training  at  the  unit  level.  This  training 
is  provided  by  ATC  through  the  means  of  Field  Training  Detach¬ 
ments  (FTDs )  located  at  most  Air  Force  installations  where  major 
units  (wings)  are  stationed.  Information  on  courses  conducted, 
individual  training  status,  and  scheduled  training  are  contained 
in  the  training  subsystem  of  the  MMICS.  The  MMICS  is  operated 
and  maintained  at  the  wing  level.  Higher  headquarters  (Major 
Command  and  HQ  USAF)  do  not  have  access  to  the  system.  The  data 
are  very  useful  at  the  wing  level  for  determining  the  type  of 


individual  training  that  is  needed,  and  for  programming  the 
training.  Wing-prepared  monthly  reports  are  provided  to  the 
Major  Command  (MAJCOM)  that  include  courses,  number  of  attendees, 
and  training  backlog. 

The  wing-level  training  provides  skill-specific  main¬ 
tenance  courses  that  are  capable  of  upgrading  basic  skills  taught 
in  technical  schools  to  a  higher  skill  level.  The  training  also 
provides  training  for  maintenance  personnel  familiar  with  one 
aircraft  type,(e.g.,  F-4),  who  are  transitioning  to  a  different 
aircraft  type,  (e.g.,  F-16).  The  wing-level  training  information 
for  each  person  assigned  is  basically  a  personal  training  history 
file  that  shows  courses  attended  (and  dates)  and  scheduled  train¬ 


ing  for  each  person.  The  MMICS  contains  individual  training 
history  files  and  course  files  that  are  used  to  generate  reports 
of  aggregate  training  status  by  course,  skill,  work  center,  and 
squadron.  The  system  is  very  flexible  and  is  able  to  furnish 
supervisors  and  analysts  with  the  information  needed  to  manage 
and  examine  individual  training. 

The  data  elements  contained  in  the  training  subsystem 
of  MMICS  ares 

•  personnel  identification: 

organization,  (e.g..  Aircraft  Generation  Squadron); 
work  center  code  (standard  within  MAJCOM); 
name ; 

employee  number  (assigned  by  wing); 
grade; 
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Duty  Air  Force  Specialty  Code  (DAFSC);  and 
Primary  Air  Force  Specialty  Code  (PAFSC);  and 


•  training  data: 

course  title  (ATC  assigned); 
course  code  (ATC  assigned); 

course  status,  (i.e.,  qualified,  scheduled,  await¬ 
ing  completion  of  training — AWACT,  overdue); 

date  due;  and 

-  date  completed. 

The  training  subsystem  is  described  in  detail  in  Air 
Force  Manual  (AFM)  66-278.— ^  The  most  commonly-used  report  is 
the  course  status  report,  an  example  of  which  is  shown  at  Exhibit 
II-l.  The  course  status  report  shows,  by  work  center,  the  train¬ 
ing  status  of  individuals  for  specified  courses.  The  report  is 
quite  useful  in  determining  the  overall  training  status  of  speci¬ 
fied  work  centers.  Each  maintenance  Air  Force  Specialty  Code 
(AFSC)  has  specific  courses  required  for  certification  at  each 
skill  level.  An  analyst  or  manager  can  quickly  determine  which 
individuals  in  a  work  center  are  trained  to  meet  their  AFSC 
requirements  using  this  report.  Analyses  of  maintenance  produc¬ 
tivity  must  begin  by  determining  individual  work  center  training 
status.  An  indication  of  work  center  training  status  can  be  ob¬ 
tained  using  the  MMICS  data.  The  training  status  of  other  groups 
(e.g.,  squadrons),  can  also  be  determined  using  MMICS  data. 

—!  Equipment  Maintenance:  Maintenance  Management  Information 
and  Control  System  (MMICS),  Maintenance  Personnel  and  Train¬ 
ing  Management  Users  Manual,  AFM  66-278,  Headquarters,  De¬ 
partment  of  the  Air  Force,  I~ February  1979. 
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In  previous  analyses  by  MCR,  the  MMICS  training  sub¬ 
system  was  used  to  gather  data,  by  work  center,  on  specified 
AFSCs.  The  data  were  then  used  to  calculate  work  center  training 
status  (i.e.,  percentage  of  fully  qualified  or  trained  personnel) 
for  a  specified  period.  The  training  status  was  then  used  to 
compare  like  work  centers  (e.g.,  jet  engine  repair)  for  the  pur¬ 
pose  of  seeing  what  effect  training  had  on  productivity.  The 
utility  of  this  system  for  intra-wing  and  inter-wing  comparisons 
of  productivity  and  the  impact  of  training  is  quite  useful. 

A  typical  analysis  that  was  performed  for  the  purpose 
of  showing  the  linkage  of  training  and  productivity  is  provided 

below.  The  full  analysis  is  documented  in  a  previous 

6/ 

report.-  The  example  provided  is  for  the  AFSC  426X4,  jet 
engine  technician,  and  the  related  work  unit  code  (system  worked 
on)  23000,  F-16  turbofan  power  plant.  The  training  and  produc¬ 
tivity  data  collected  are  displayed  on  Exhibit  II-2.  A  graph  of 
training  effects  is  shown  on  Exhibit  II-3.  Tests  using  statis¬ 
tical  methods  were  used  to  calculate  the  significance  of  these 
effects.  However,  the  purpose  of  these  exhibits  is  to  show  the 
type  of  graphics  that  can  be  developed  using  the  MMICS. 

2.  Pipeline  Management  System 

The  Air  Force  PMS  is  operated  by  ATC  and  is  used  to 
maintain  training  information  on  Air  Force  schools  and  on  per¬ 
sonnel  attending  those  schools.  The  PMS  is  both: 

6/  Rodney  D.  McConnell  and  Stuart  C.  Johnson,  Op.  Cit. 
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AVERAGE  WORKHOURS  PER  OBSERVATION  (FREQUENCY) 


Exhibit  II-2.  DATA  COLLECTED 


a  data  system  that: 


converts  training  requirements  into  school  seats, 

allows  names  to  be  placed  against  seats,  and 

provides  accounting  of  students  who  fill  the 
seats;  and 

•  a  management  system  that: 

provides  for  management  control  over  critical  pro¬ 
cesses,  and 

integrates  the  total  training  process  and  allows 
management  decisions  based  on  a  single  data  base. 

The  Air  Force  uses  the  PMS  to  provide: 

•  measurable  comparisons  necessary  to  check  the  capa¬ 
bility  of: 

the  training  program  to  meet  requirements, 

the  procurement  function  to  fill  the  training  pro¬ 
gram, 

the  training  centers  to  handle  incoming  students, 
and 

the  personnel  assignments  to  meet  utilization  re¬ 
quirements  ; 

•  a  capability  to  identify  cost  trade-offs  within  and 
between  the  functions  of: 

training  requirements, 

training  programs, 

procurement  functions, 

training  resources,  and 

assignment  utilization; 

•  a  tracking  capability  which  will  show  the  actual  status 
of  the  pipeline  functions; 

•  a  single  training  requirements  quota  bank  against  which 
incoming  students  and  new  recruits  may  be  confirmed; 


it 


m  an  integrated  skills  management  system  with  feedback  to 
management  so  that  management  can  effect  adjustment  and 
control  over  pipeline  activity. 

The  total  PMS  data  base  contains  700  million  characters 
of  training-related  data  elements,  and  supports  the  system  func¬ 
tions.  AFR  300-4,  Data  Automation:  Air  Force  Data  Dictionary, 
contains  detailed  descriptions  of  the  data  elements.  A  list  of 

the  data  elements  contained  in  the  PMS  data  base  was  documented 

7/ 

in  a  previous  report.”  PMS  system  functions  are: 

•  Requirements,  the  automated  capability  of  identifying 
future  training  requirements  for  individual  training; 

•  Planning,  the  scheduling  of  school  seats  for  future 
classes ; 

•  Allocation/Confirmation,  the  notification  to  training 
requestors  of  class  seats  assigned  to  them  and  the  by¬ 
name  confirmation  of  students  selected  to  attend  train¬ 
ing,  including  placing  quota  records  on  the  student 
accounting  data  base;  and 

•  Student  Accounting,  the  actual  data  on  student  loads  by 
class  and  date  for  present  and  future  time  periods. 

When  information  is  needed  by  the  Air  Staff,  they  con¬ 
tact  ATC  and  request  whatever  data  are  required.  The  PMS  fully 
integrates  requirements,  scheduling,  allocation,  and  distribu¬ 
tion.  The  system  allows  for  management  of  initial  entry  train¬ 
ing,  skill  progression  training,  and  other  career  development 
training.  Real-time  reports  show  what  seats  have  been  allocated 
by  course,  how  many  have  been  filled  to  date,  and  how  many  are 


2 /  Rodney  D.  McConnell  and  Carolyn  G.  Jones,  Skill  Training 
Analysis:  An  Examination  of  DoD-Wide  Training  and  Main¬ 


tenance  Data  Systems,  WN-8402-1,  Management  Consulting  & 
Research,  Inc.,  27  July  1984. 


available.  PMS  provides  an  efficient  way  to  smooth  out  fluctua¬ 
tions  in  training  flows,  reduce  waiting  time,  and  permit  faster, 
more  precise  response  to  changing  requirements.  Terminals  at  the 
Technical  Training  Centers  (TTCs),  ATC,  and  MAJCOMs  allow  system 
access.  Air  Force  training  information  for  schools  is  obtained 
from  the  ATC-operated  PMS.  User  interface  with  the  PMS  is  shown 
on  Exhibit  II-4. 

In  addition  to  Air  Force  Major  Commands,  ATC  allocates 
class  seats  for  technical  training  courses  to  the  Air  National 
Guard  and  Air  Force  Reserve,  other  Services,  non-DoD  agencies, 
and  foreign  governments.  Civilians,  as  well  as  military  person¬ 
nel,  receive  this  training. 

B.  AIR  FORCE  MAINTENANCE  DATA  COLLECTION  SYSTEM 

This  subsection  discusses  the  Air  Force  Maintenance  Data 
Collection  (MDC)  system  by  providing: 

•  description,  and 

•  data  elements. 

1 .  Description 

The  Air  Force  Maintenance  Data  Collection  (MDC)  system 
contains  maintenance  data  submitted  by  work  centers  for  each  job 
performed.  Output  information  is  sorted  by  work  center,  compon¬ 
ent  serviced  (i.e.,  work  unit  code),  and  work  action  taken. 


Aggregate  data  may  be  furnished  by  work  center,  component 
serviced,  total  work  actions,  and  total  hours.  Maintenance  pro¬ 
ductivity  is  measured  using  the  number  of  man-hours  needed  to 


SIMULATION  MODEL  FOR  THE  ALLOCATION 
OF  BESOURCE  TRAINING 


Exhibit  II-4.  PIPELINE  MANAGEMENT  SYSTEM 
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successfully  complete  a  maintenance  action,  (i.e.,  the  perfor¬ 
mance  of  one  procedure  on  one  item  of  equipment). 

2 .  Data  Elements 

The  supervisor  or  mechanic  prepares  a  Maintenance  Data 
Collection  Record,  AFTO  Form  349,  which  is  used  to  record  data 
for  the  MDC  system.  An  example  of  this  form  is  shown  on  Exhibit 
11-5.  "Equipment  being  maintained  is  identified  by  the  values  of 
the  work  unit  code  (WUC)  @  (Code  numbers  used  here  refer  to  the 
item  identifiers  in  Exhibit  II-5)  and  the  Standard  Reporting 
Designator  ( SRD )  @  ,  a  three-character  code  that  denotes  the 

type  of  equipment  end-item.  What  is  wrong  with  the  equipment  is 
given  by  the  how-malfunction  code  ©  .  What  was  done  in  the 

course  of  maintenance  is  contained  in  the  type-maintenance  Q) 
and  action-taken  (5)  codes.  Who  performed  the  maintenance  task 
is  identified  through  the  combination  of  work  center  ©  and  the 
maintenance  organization  containing  the  work  center,  where  the 
identification  of  the  organization  is  provided  by  the  processing 
routines  that  transfer  the  hardcopy  information  to  MDC  records. 
Man-hours  expended  are  calculated  during  ADP  processing  from  the 
start-hour,  stop-hour,  and  crew  size  values  (J)  •  A  separate 

line  of  information  is  recorded  each  time  there  is  a  change  in 
any  of  the  columns  A  through  N.,  including  changes  in  crew  size  or 
composition,  and  each  line  results  in  a  distinct  record. 
Employee  number  (§)  typically  names  a  shop  supervisor  or  lead 
technician  and  should  not  be  a  reliable  guide  to  identifying 


MAINTENANCE  DATA  COLLECTION  RECORD 


Exhibit  II-5 .  AFTO  FORM  349,  MAINTENANCE  DATA  COLLECTION  RECORD 


individuals  actually  performing  maintenance.  In  addition,  this 

.  ,  8/ 

information  is  not  transferred  to  MDC  records."- 

The  MDC  system  is  described  in  AFR  66-1  and  documents  a 

sufficient  amount  of  information  to  ascertain  what  was  worked  on 

(WUC),  what  was  wrong,  what  was  done  (action  taken  code),  how 

many  workhours  were  used,  and  who  did  the  work  (work 
x  9/ 

center).-  System  outputs  that  are  useful  for  analyses  are 
work  unit  code  (equipment  code)  reports  that  provide  the  neces¬ 
sary  productivity  data  by  work  center.  An  example  is  shown  on 
Exhibit  II-6.  The  acronyms  used  are: 

PWC  -  primary  work  center  TM  -  team  WD  -  where 

WUC  -  work  unit  code  CS  -  crew  size  determined 

AT  -  action  taken  code  JCN  -  job  control  number  code 

DAY  -  Julian  date  HRS  -  hours  worked 


C.  SUMMARY  OF  ANALYSIS 

The  current  MDC  system  is  useful  for  analyses  of  training 
effectiveness  since  it  provides  a  means  of  measuring  work  center 
productivity.  However,  it  cannot  precisely  identify  which 
workers  did  a  particular  job.  This  does  not  preclude  analytical 
comparisons,  but  it  does  limit  the  precision  of  the  analysis. 


®/  Jesse  Orlansky  and  Joseph  String,  Evaluating  the  Effective¬ 
ness  of  Maintenance  Training  by  Using  Currently  Available 


Maintenance  Data,  IDA  Paper  P-1574,  Institute for  Defense 
Analyses ,  August 1981 . 

Equipment  Maintenance:  Maintenance  Management,  Air  Force 
Regulation  { AFR )  66-1  ,  Headquarters ,  U.S.  Air  Force,  2  July 
1980. 
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In  order  to  benefit  the  current  system  and  assist  in  the 
analysis  of  training  and  related  maintenance  productivity  at 


i 


n 


wing-level  and  above,  two  improvements  have  been  suggested  in  our 

10/ 

previous  work.  The  first  is  the  entry  of  the  employee 
numbers  of  all  maintenance  personnel  in  the  applicable  work  crew. 
This  would  allow  more  direct  and  precise  measurement  of  the 
effect  of  training  on  productivity  for  both  individuals  and  work 
centers.  Productivity  as  measured  in  this  analysis  is  speed  of 
performance.  Productivity  can  include  quality  of  performance 
such  as  improved  indentif ication  of  faults,  better  use  of  spare 
parts,  and  similar  indices  of  interest.  The  second  suggestion  is 
greater  use  of  component -leve 1  designation  for  maintenance 
reporting,  rather  than  system  or  subsystem  designation.  This 
would  more  precisely  define  the  work-to-training  information  and 
make  time-to-repair  a  more  accurate  figure. 

ATC  can  predict  future  training  loads  based  on  PMS  data  and 
furnishes  this  information  to  the  Air  Staff  for  PPBS  purposes. 
Consolidated  training  information  on  formal  schooling  is  obtain¬ 
able  from  ATC  by  means  of  PMS  data.  Ins  t  a  1 1  a  t  i  on-leve  1  indivi¬ 
dual  training  data  are  not  easily  obtained  since  each  wing  must 
be  contacted  separately  and  no  central  data  base  is  in-being. 


to  _ 

JL2/  Rodney  D.  McConnell  and  Stuart  C.  Johnson,  Op.  Cit. 
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III.  ARMY  DATA  SYSTEMS 


This  section  discusses  Army  data  systems,  including  those 
used  for  unit-level  training,  all-Army  training,  and  maintenance. 

The  topics  addressed  are: 

•  Army  Training  Data  Systems, 

•  Army  Maintenance  Data  System,  and 

•  Summary  of  Analysis. 

I 

i 

t 

A.  ARMY  TRAINING  DATA  SYSTEMS 

There  is  only  one  official  Army  training  data  system — the 
Army  Training  Requirements  and  Resources  System  ( ATRRS )  .  Cur¬ 
rently  there  is  no  official  unit-level  system,  although  one  is 
under  test.  This  subsection  discusses  Army  unit-level  training 
data  sources  and  ATRRS. 

1 .  Unit-Level  Training  Data  Sources 

Army  installation-level  training  differs  significantly 
from  Air  Force  installation-level  training.  The  training  is  con¬ 
ducted  in  the  Army  by  an  installation-level  school  or  a  contrac¬ 
tor.  It  is  funded  from  installation  resources  and  not  by 
centrally-funded  Army  training  resources  controlled  by  the  Train¬ 
ing  and  Doctrine  Command  (TRADOC).  The  function  of  Army 
installation-level  training  includes: 

•  supplementing  training  received  in  formal  Army  schools 
with  equipment-specific  instruction, 

•  providing  transition  training  for  personnel  with  ex¬ 
perience  on  other  models  of  equipment,  and 

•  providing  upgrade  or  refresher  training. 
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There  is  no  standard  Army  system  for  maintaining  in¬ 


stallation-level  training  data  on  individual  training.  The 
closest  approximation  is  the  Maintenance  Performance  System  (MPS) 
that  has  been  developed  by  the  Army  Research  Institute  (ARI). 
The  MPS  is  a  training  needs  information  system  for  use  at  unit 
level  (battalion)  that  is  currently  under  test  as  a  part  of  a 
research  program  in  an  Army-wide  effort  to  improve  maintenance. 
The  MPS  has  been  tested  in  both  direct  support  (DS)  and  organiza¬ 
tional  maintenance.  The  DS  test  encompassed  two  units  at  Ft. 
Polk  and  Ft.  Carson.  The  organizational  maintenance  test  simi¬ 
larly  encompassed  two  operational  units  at  the  same  installa¬ 
tions.  MPS  data  include  information  on  specific  maintenance 
tasks  performed  and  individual  training  status.  The  MPS  allows 
for  analyses  of  individual  performance,  although  the  current  data 
bases  are  very  small  and  do  not  allow  for  any  analysis  of  train¬ 
ing  or  maintenance  performance  in  the  aggregate. 

The  MPS  was  designed  for  use  in  a  divisional  mainten¬ 
ance  battalion  for  the  DS  level  system,  and  in  division  opera¬ 
tional  battalions  for  the  organizational  level  system.  Currently 
the  system  is  completing  a  test  phase.  Plans  are  to  incorporate 
the  organizational  level  MPS  into  the  newly-emerging  Unit-Level 
Logistics  System  (ULLS)  which  is  being  tested  as  a  battalion- 
level  logistics  reporting  system.  Once  ULLS  is  completed  (com¬ 
pletion  date  unknown  at  this  time),  the  MPS  will  provide  both 
training  and  maintenance  information  for  analyses  at  the  opera¬ 
tional  unit  level.  The  DS  level  MPS  will  be  incorporated  in  the 
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Standard  Army  Maintenance  System  (SAMS)  when  it  becomes  opera¬ 
tional.  SAMS  is  still  under  development,  with  a  completion  date 
several  years  in  the  future.  Thus,  both  MPS  systems  (DS  and 
organizational)  will  not  be  available  for  the  near  term.  Details 

of  the  type  of  data  available  from  MPS  are  available  from  ARI  in 

11/ 

the  user's  manual. —  The  system  uses  nine  forms  to  collect 
data  for  input  to  the  data  base,  and  has  nine  standard  output 
tables.  The  input  forms  are: 

•  MPS-1  Job  Order  Status, 

•  MPS-2  Job  Task  Performance, 

•  MPS— 3  Daily  Man-Hour  Availability, 

•  MPS— 4  Roster  Update, 

•  MPS-5  Training/Performance  Demonstration, 

•  MPS-6  Task  Experience  History, 

•  MPS-7  Special  Priority  Flag, 

•  MPS-8  Interpretation  Comments,  and 


The  o 


•  MPS-9  Training  Requirement  Priority  Threshold, 
utput  tables  are : 

•  Table  1  Man-hour  Availability  and  Use, 

•  Table  2  Average  Direct  Man-Hours  Per  Job, 

•  Table  3  Average  Direct  Man-Hours  Per  Job  by  Equipment 

and  Task, 

•  Table  4  Average  Job  Throughput  Time  in  Days, 

•  Table  5  Average  Days  Spent  in  Each  Job  Status, 


11/  Maintenance  Performance  System:  User's  Reference  Manual, 


U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences,  January  1981. 
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•  Table  6  Skill  and  Growth  Indexes, 

•  Table  7  Skill  Development  Summary, 

•  Table  8  Individual  Skill  History,  and 

•  Table  9  Training  Requirements  Summary. 

In  summary,  analyses  of  Army  training  at  the  installa¬ 
tion  level  and  its  effect  on  maintenance  productivity  is  not 
possible  using  currently  available  data.  The  best  source  in  the 
future  will  be  the  MPS  when  it  is  continued  and  expanded.  How¬ 
ever,  it  is  in  a  test  mode  and  is  designed  to  help  the  small  unit 
improve  maintenance,  not  support  higher-level  analyses.  As  MPS 
expands,  and  is  possibly  included  as  part  of  the  upcoming  Stan¬ 
dard  Army  Maintenance  System  (SAMS),  it  would  certainly  provide 
data  on  both  individual  training  status,  as  well  as  related  work 
performance,  and  thus  provide  useful  data  on  training /maintenance 
productivity . 

2. 


a .  Description 

The  ATRRS  contains  information  for  schools  and 
training  centers.  Information  is  drawn  from  and  provided  to  the 
HQ  DA  staff,  the  Military  Personnel  Center  (MILPERCEN),  the 
Reserve  Component  Personnel  and  Administration  Center  (RCPAC), 
the  National  Guard  Bureau  (NGB),  TRADOC,  Office  of  The  Surgeon 


Army  Training  Requirements  and  Resources  System 
The  ATRRS  is  discussed  under  the  following  headings: 
description,  and 


data  elements. 


General  (OTSG),  Office  of  the  Chief  of  Engineers  (OCOE),  The 
Adjutant  General's  Office  (TAGO) ,  and  Army  schools  and  training 
centers.  The  major  product  of  the  ATRRS  is  the  Army  Program  for 
Individual  Training  (ARPRINT),  which  provides  guidance  on  trainee 
and  student  inputs,  and  detailed  training  seat  information  by 
class  and  course.  The  ARPRINT  serves  as  a  major  resourcing  docu¬ 
ment  to  be  executed  by  TRADOC,  OTSG,  DoD  schools,  and  other 
agencies.  The  ARPRINT  is  provided  to  U.S.  Army  reception 
stations,  training  centers,  and  Service  schools  to  meet 
requirements  for  trained  manpower  over  time. 

Training  requirements  are  maintained  in  the  ATRRS 
data  base  by  course  and  fiscal  year.  A  large  variety  of  summary- 
type  reports,  such  as  ARPRINT,  may  be  requested  that  provide 
required  information  on  specific  types  of  training  conducted  by 
schools.  The  ATRRS  contains  data  on  all  DoD  schools  that  Army 
personnel  attend.  There  is  very  little  formal  training  outside 
the  Army  school  system  and  no  data  base  for  informal  schools  con¬ 
ducted  by  installations  and  units  throughout  the  Army. 

ATRRS  supports  institutional  training  missions  by 
determining  requirements,  objectives,  manpower,  and  costs,  and 
allows  managers  to  maintain  the  force  structure  of  the  Army  by 
scheduling  classes,  filling  seats,  and  training  soldiers.  Data 
are  broken  out  at  the  course  level  of  detail  for  all  courses  con¬ 
cerning  Army  personnel.  ATRRS  produces  reports,  graphs,  analy¬ 
ses,  and  selected  data  displays  pertaining  to  requirements, 
entrants,  graduates,  training  loads,  and  associated  information. 
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The  Mobilization  Training  Planning  System  (MTPS), 
a  subsystem  of  ATRRS,  is  a  peacetime  planning  system  for  mobili¬ 
zation  training.  During  mobilization,  either  full  or  partial, 
data  from  MTPS  are  fed  into  the  ATRRS  operational  subsystem  for 
individual  training  management.  MOB  ARPRINT  provides  individual 
training  requirements,  by  course  and  by  week,  for  the  52-week 
period  beginning  with  mobilization  and  a  time-phased  plan  for 
expanding  inputs  to  training. 

ATRRS  is  a  source  of  accurate,  timely,  and  respon¬ 
sive  training  input  data  which  provides  information  to  the  Army 
staff  for  response  to  OSD,  Office  of  Management  and  Budget  (OMB), 
and  Congressional  inquiries. 

Another  key  ATRRS  document  is  the  input  for  the 
Military  Manpower  Training  Report  (MMTR) .  The  MMTR  supports  the 
DoD  request  for  Congressional  authorization  of  student  training 
loads  in  individual  training. 

ATRRS  calculates  projected  training  inputs  and 
loads  used  as  a  basis  for  providing  resources  for  the  Army's 
school  system  and  is  the  mechanism  through  which  HQ  DA  correlates 
training  requirements  to  the  Army's  recruiting  objectives, 
b .  Data  Elements 

The  ATRRS  data  base  consists  of  the  following  six 
integrated  interactive  files: 

•  Administrative  File  (ADMIN), 

•  Requirements  File  (RQR), 

•  Class  File  (CLS), 


•  Reservations  File  (RES), 

•  Course  Catalog  File  (CRSCAT),  and 

•  Verfication  Tables  File  (VER) . 

Data  elements  contained  in  these  files  are  listed  and  described 

in  alphabetical  order  regardless  of  which  file  contains  the  ele- 

12/ 

ment .  This  list  was  documented  in  a  previous  report. — 

ARPRINTs,  the  key  reports  produced  by  ATRRS ,  are 
shown  on  the  following  three  exhibits.  These  reports  provide 
training  managers  with  the  flexibility  to  have  reports  at  the 
MOS/Course/Class  level  of  detail,  by  a  variety  of  time  periods 
and  levels  of  summarization.  In  addition  to  the  key  ARPRINT 
reports ,  ATRRS  produces : 

•  Attrition  Reports; 

•  Army  Pipeline  System  (APS)  Reports; 

•  The  ARPRINT  Class  Schedule  (TACS)  Reports; 

•  Budget  Reports ;  and 

•  Other  ATRRS  reports,  such  as  input  data  for  the  MMTR. 

The  Draft  ARPRINT  is  shown  on  Exhibit  III-l.  A 
multi -page  report,  the  Draft  ARPRINT  shows  detailed  new  training 
requirements  by  course  for  five  fiscal  years  as  of  a  specific 
month,  Exhibit  III-l  is  a  partial  listing  for  three  years.  The 
new  requirements  are  assigned  to  training  programs  in  the  Final 
ARPRINT  as  shown  in  Exhibit  III-2 .  The  annual  training  require- 
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ment  is  distributed  by  week  over  a  specified  fiscal  year.  The 
distribution  is  based  on  seasonality  factors  supplied  by  the 
Office  of  the  Deputy  Chief  of  Staff  for  Personnel  (ODCSPER) .  The 
factors  used  are  listed  on  the  first  page  of  the  report,  which  is 
shown  on  Exhibit  III-3. 

B.  ARMY  MAINTENANCE  DATA  SYSTEM 

This  subsection  discusses  the  Army  maintenance  data  system 
in  the  following  order: 

•  description,  and 

•  data  elements. 


1.  Description 


Army  maintenance  data  are  generated  by  records  produced 
for  all  maintenance  actions  performed.  Data  are  incorporated  in 
The  Army  Maintenance  Management  System  (TAMMS).  TAMMS  is  auto¬ 
mated  at  the  installation-level  and  includes  information  on  unit 


records  needed  to  manage  the  maintenance  of  equipment,  princi¬ 
pally  the  use  of  parts  and  what  equipment  was  repaired.  Data  on 
time  to  repair,  who  accomplished  the  work,  and  similar  produc¬ 
tivity  data  are  not  recorded.  Hence,  the  system  does  not  allow 
for  linkage  of  training  and  productivity. 
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An  improved  system,  the  Standard  Army  Maintenance  Sys¬ 
tem  (SAMS),  is  in  progress,  will  eventually  replace  TAMMS,  and 
will  encompass  all  levels  of  Army  materiel  maintenance.  SAMS 
will  improve  upon  the  present  TAMMS  system  in  that  a  maintenance 
job  will  be  "tracked"  on  an  in-shop  computer  as  it  progresses 
through  work  stages,  and  each  different  stage  of  work  will  be 
explicitly  noted  in  the  job  record.  Therefore,  the  records 
should  be  more  accurate  than  those  in  TAMMS  (which  is  automated 
at  a  much  higher  level)  and  include  more  detailed  data  on  partic¬ 
ular  actions  performed. 

2 .  Data  Elements 

In  TAMMS,  all  maintenance  data  are  recorded  on  DA  Form 
2407,  Maintenance  Request,  Exhibit  III-4.  What  was  wrong  is  in¬ 
dicated  by  the  Failure  Code  ©  (code  numbers  used  here  refer  to 
the  item  identifiers  in  Exhibit  III-4).  What  was  done  is  indi¬ 
cated  by  the  Action  Code  ©  .  Total  manhours  expended  are 
recorded  in  ©  .  One  Maintenance  Request  form  can  be  used  to 
document  a  complete  maintenance  action,  but  each  change  in  action 
or  failure  codes,  or  in  components/parts  involved  in  the  mainte¬ 
nance,  is  documented  on  a  separate  line  of  these  fields. 

The  unit  performing  the  maintenance  is  identified  by 
its  Unit  Identification  Code  (UIC),  a  code  assigned  to  all  Army 
units.  For  maintenance  accomplished  at  the  intermediate  level, 
the  UIC  is  entered  in  ©  .  At  the  organizational  level,  the  UIC 
is  entered  at  ©  ;  ©  is  left  blank. 


The  way  in  which  the  equipment  being  maintained  is 
identified  differs,  depending  on  whether  off-equipment  or  on- 
equipment  maintenance  is  performed.  For  off-equipment  main¬ 
tenance,  the  National  Stock  Number  (NSN)  of  the  system  removed 
from  an  end-item  is  recorded  at  ©  and  the  model  name  and  NSN  of 
the  actual  component  being  maintained  is  recorded  at  @  .  The 
NSN  is  the  basic  cataloging  system  used  by  all  Services  to  refer 
to  unique  configurations  of  end-items,  major  systems,  subsys¬ 
tems,  and  assemblies,  and  to  components/parts  with  unique 
characterisics .  For  individual  maintenance  tasks  on  the  assembly 
as  a  whole,  such  as  adjustment  or  inspection,  (g)  and  (^)  show 
the  NSN  of  the  assembly. 

The  way  in  which  on-equipment  work  is  identified  dif¬ 
fers,  depending  on  whether  aircraft  or  ground  equipment  is  being 
maintained.  For  maintenance  of  aircraft,  the  model  number  and 
NSN  of  the  end-item  is  recorded  in  Q)  and  the  subsystem  requiring 
maintenance  is  identified  by  the  Component  Breakdown  (CB)  code  at 
©  .  Individual  maintenance  tasks  are  described  at  (8)  .  Re¬ 
placed  parts  are  identified  by  NSN  at  (l^  .  For  ground  equip¬ 

ment,  the  model  number  and  NSN  of  the  end- item  are  contained  in 
.  The  system,  assembly,  or  part  being  repaired  or  replaced  is 
identified  at  (§)  .  The  NSN  of  the  part  replaced  is  contained  at 

ia 


c. 


SUMMARY  OF  ANALYSIS 


The  ATRRS  system  provides  a  great  deal  of  information  to 
managers  and  analysts  which  is  useful  for  analytical  purposes. 


tion,  can  be  used  for  comparison  with  available  resources  by  Army 
staff  agencies.  The  MMTR  input  report  is  a  particularly  useful 
report  since  it  provides  summary  detail,  by  category  of  training, 
including  inputs,  outputs,  and  training  loads.  The  MMTR  input 
report  can  also  be  used  for  comparative  purposes  with  available 
training  resources  at  a  higher  level  of  aggregation,  such  as 
total  Army  initial  skill  training. 

A  previous  study  has  documented  the  inadequacies  of  TAMMS 
data  for  analyzing  training  effectiveness.—^  TAMMS  was  de¬ 
signed  to  provide  information  for  purposes  of  maintenance  and 
logistics,  not  for  the  purpose  of  evaluating  maintenance  perfor¬ 
mance  by  individuals.  The  biggest  problem  with  this  data  base, 
for  evaluating  training,  is  that  the  names  of  individuals  who 
perform  maintenance  actions  are  not  maintained  in  the  central 
data  files.  The  Army  practices  both  team  and  cross-skill  main¬ 
tenance  in  peacetime,  since  that  is  the  manner  in  which  Army 
units  will  operate  under  combat  conditions.  Further,  many  Army 
maintenance  units  are  not  structured  into  work  centers,  so  there 
is  no  way  to  identify  the  skill  areas  of  personnel  performing  the 
maintenance.  The  maintenance  reporting  format  also  has  no  pro¬ 
vision  for  noting  where  team  maintenance  occurs.  Because  the 
ability  to  identify  and  track  individuals  is  central  to  any  meth¬ 
odology  for  relating  maintenance  performance  to  training,  TAMMS 
data  are  not  appropriate  for  training  analysis. 

lil/  Jesse  Orlansky  and  Joseph  String,  Op.  Cit. 


The  upcoming  SAMS  system  is  also  not  designed  for  training 
analysis  purposes;  no  information  that  identifies  individuals  is 
included  in  this  system.  The  system,  however,  is  still  in  pre¬ 
liminary  implementation  stages.  Data  elements  could  be  added  to 
the  system.  The  possible  inclusion  of  the  ARI -developed  Main¬ 
tenance  Performance  System  (MPS)  within  SAMS  would  allow  train¬ 
ing/productivity  analyses  to  be  developed.  Discussion  of  MPS  is 
contained  in  Section  III.A.l.  above.  Even  if  individual  identi¬ 
fication  were  not  included  in  the  system,  the  improvements  in 
accuracy  and  level  of  detail  over  the  TAMMS  data  base  could  be  of 
benefit  for  training/productivity  analyses. 
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IV.  NAVY  AND  MARINE  CORPS  DATA  SYSTEMS 


This  section  discusses  Navy  and  Marine  Corps  data  systems 
that  can  provide  information  for  analyses  of  training  and  related 
maintenance.  The  topics  addressed  are  the  following: 

•  Training  Data  Systems,  which  discusses  the 

Navy  Integrated  Training  Resources  and  Administra¬ 
tion  System,  and  the 

Marine  Corps  Training  System; 

•  Maintenance  Data  System,  which  discusses  the  Navy 
Aviation  3-M  system  that  maintains  data  for  both  the 
Navy  and  Marine  Corps ;  and 

•  Summary  of  Analysis. 

A.  TRAINING  DATA  SYSTEMS 

This  subsection  provides  information  on  the  Navy  and  Marine 
Corps  training  data  systems.  The  Navy  system  is  operated  by  the 
Chief  of  Naval  Education  and  Training  (CNET)  and  the  Marine  Corps 
System  is  operated  by  Headquarters,  Marine  Corps.  The  following 
topics  are  addressed: 

•  Navy  Integrated  Training  Resources  and  Administration 
System,  and  the 

•  Marine  Corps  Training  System. 

1 .  Navy  Integrated  Training  Resources  and  Administration 
System 

The  all-Navy  data  system  that  provides  information  on 
training  is  operated  by  the  Chief  of  Naval  Education  and  Train¬ 
ing  (CNET)  located  in  Pensacola,  Florida.  It  is  called  the  Navy 


Integrated  Training  Resources  and  Administration  System  (NITRAS). 
There  is  no  local  training  data  system.  The  system  contains  in¬ 
formation  on  all  Navy  training.  Our  research  was  directed  toward 
Navy  aviation  units  and  we  visited  the  Navy  Maintenance  Training 
Detachment  ( NAMTRADET )  at  the  Moffett  Naval  Air  Station  (NAS), 
California.  NITRAS  receives  information  from  the  local  level 
(e.g.,  NAMTRADET)  and  incorporates  it  into  the  data  base.  Local 
stations  receive  copies  of  the  system-generated  reports  based  on 
their  inputs. 

NITRAS  is  an  automated  system  that  provides  training 
information  to  training  managers  throughout  the  Navy.  NITRAS 
also  provides  direct  support  to  the  Chief  of  Naval  Personnel  and 
the  Commander,  Navy  Recruiting  Command.  Information  summaries 
are  often  required  by  top  levels  of  Navy  training  management  to 
justify  resource  requirements  in  the  Program  Objective  Memoran¬ 
dum  and  during  the  budget  process.  NITRAS  provides  CNET  with  the 
automated  capability  to  manage  and  support  the  total  Navy  train¬ 
ing  effort. 

Exhibit  IV-1  portrays  the  NITRAS  reporting  flow.  CNET 
input  forms  are  originated  at  the  training  activity  level  and 
sent  to  the  NITRAS  management  office,  where  they  are  reviewed  for 
errors  and  invalid  transactions.  The  forms  are  then  input  into 
the  monthly  update  of  the  system  and  the  reports,  interfaces,  and 
extracts  are  produced  as  required. 

The  NITRAS  has  three  principal  files  that  are  described 


below: 


Master  Course  Reference  File, 


•  Student  Master  File,  and 

•  Training  Summary  File. 


a .  Master  Course  Reference  File 

The  Master  Course  Reference  File  (MCRF)  corrects 
and  standardizes  course  data  elements  and  class  schedules  of  all 
formal  course  training  at  a  central  point.  MCRF  functions  in¬ 
clude  : 

•  serving  as  a  common  data  base  for  all  files  constitut¬ 
ing  NITRAS,  preventing  duplication  in  reporting  and 
file  maintenance; 

•  supporting  the  Recruiting  Command's  Personalized 
Recruiting  for  Immediate  and  Delayed  Enlistments 
(PRIDE)  and  the  detailers  at  the  Navy  Military  Person¬ 
nel  Center  (NMPC)  detailers  by  providing  class  quotas 
and  convening  dates; 

•  interfacing  between  NITRAS  and  the  Catalog  of  Navy 
Training  Courses  (CANTRAC),  contributing  to  CANTRAC 
publication; 

•  compiling  training  requirements  and  training  operations 
plan  information  by  course  for  past,  current,  and  six 
future  years;  and 

•  compiling  student  statistics  at  class  level,  providing 
management  with  the  capability  to  monitor  class  utili¬ 
zation  and  student  performance  in  general  and  training 
quota  management  in  particular. 

MCRF  consists  of  three  records:  the  Course 

Record,  the  Class  Schedule  and  Quota  Record,  and  the  Training 

Plans  Record. 

•  The  Course  Record  is  identified  on  form  CNET  GEN 
1510/17  which  contains  general  descriptive  data  of  the 
course.  This  record  also  includes  the  course  data  pro¬ 
cessing  ( CDP )  code  assigned  by  the  NITRAS  manager. 
Required  ASVAB  scores  are  identified  by  CNET  GEN 
1517/17D. 


The  Class  Schedule  and  Quota  Record  is  identified  on 
form  CNET  GEN  1510/17A  and  on  form  CNET  GEN  1510/17E. 
Specific  data  on  class  quotas  are  listed  on  form  CNET 
GEN  1510/17C.  Class  schedules  for  Naval  Air  Mainten¬ 
ance  Training  Detachment  (NAMTRADET)  courses  need  not 
be  submitted  since  they  are  often  included  in  the  Fleet 
Replacement  Aviation  Maintenance  Program  (FRAMP)  pipe¬ 
line.  Class  schedules  are  generated  for  NAMTRADET  as  a 
result  of  students  being  reported  to  the  Student  Master 
File.  Schedules  for  FRAMP  courses  are  required  to  be 
submitted  for  personnel  detailing  and  planning  pur¬ 
poses  . 

The  Training  Plans  Record  is  identified  by  form  CNET 
GEN  1510/17B.  This  record  controls  the  Training  Opera¬ 
tions  and  Training  Requirements  Plan.  This  applies  to 
all  courses  except  those  controlled  by  the  Training 
Requirements  and  Planning  Subsystem  (TRAPS). 

Courses  are  reported  to  MCRF  as  follows: 

all  formal  training  courses  listed  in  CANTRAC  are 
reported  and  maintained  by  the  appropriate  MCRF  coor¬ 
dinator  and  training  activity  according  to  the  Course 
Identification  Number  (CIN),  as  follows: 

A  Chief  of  Naval  Technical  Training 

B  Chief,  Bureau  of  Medicine  and  Surgery 

C  Chief  of  Naval  Technical  Training  (Aviation  Skill 
Courses ) 

D  Commander,  Naval  Air  Force,  U.S.  Atlantic  Fleet 

E  Commander,  Naval  Air  Force,  U.S.  Pacific  Fleet 

F  Commander,  Submarine  Force,  U.S.  Atlantic  Fleet 

G  Commander,  Naval  Surface  Force,  U.S.  Atlantic 

Fleet 

H  Commander,  Naval  Surface  Force,  U.S.  Pacific  Fleet 

J  Commander,  Training  Command,  U.S.  Atlantic  Fleet 

K  Commander,  Training  Command,  U.S.  Pacific  Fleet 

L  Commander,  Submarine  Force,  U.S.  Pacific  Fleet 

Commanding  Officer,  NASC  Representative,  U.S. 
Atlantic  Fleet 


M 


N  Commanding  Officer,  NASC  Representative,  U.S. 
Pacific  Fleet 

(M&N  scheduled  to  merge  into  one  command) 

P  Chief  of  Naval  Education  and  Training 
Q  Chief  of  Naval  Air  Training 

R  Chief  of  Naval  Reserves 

S  Other  Commands  not  assigned  above 

X  X-777-777X —  Ch i e  f  of  Naval  Technical  Training 
only.  Other  X  CIN's  may  be  utilized  by  any  MCRF 
coordinator . 


•  Recruit  training  and  other  formal  or  informal  training 
not  contained  in  CANTRAC  are  reported  to  ensure  com¬ 
plete  student  and  workload  accountability  and  to  iden¬ 
tify  the  different  categories  for  management  reporting 
purposes : 

X-444-4440  Activity  Student  Indoctrination 

X- 5 5 5- 5 5 50  Student  Transients  (Awaiting  transfer) 


X-666-6660  Sea  Cadet  Training 

X-777-7770  Basic  Recruit  Training 


X-777-7771 

X-777-7772 

X-777-7773 

X-777-7774 

X-888-8880 

X-999-9990 

Programmed  Instruction, 


Airman  Apprenticeship 
Seaman  Apprenticeship 
Fireman  Apprenticeship 
Constructionman  Apprenticeship 
Specialized  Brief /Training 
Naval  Reserve  Training/Drills 
Self-Paced,  or  other  courses  not  adhering 


to  established  convening  or  graduating  dates  are  reported  and 
identified . 


•  All  PRIDE  courses  (courses  that  support  Recruiting 
Command's  reservations  for  new  accessions)  are  entered 
into  the  MCRF  data  base.  Once  entered,  changes  to  class 
schedules,  training  operations  plans,  and  class  quotas 
for  PRIDE  courses  are  kept  to  a  minimum.  Any  changes 
must  be  coordinated  with  the  Chief  of  Naval  Personnel 
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(CHNAVPERS)  and  the  Commander,  Navy  Recruiting  Command. 
PRIDE  includes  training  operations  plans  and  class 
quotas  for  all  active  and  reserve  inputs. 

Close  coordination  is  required  between  CHNAVPERS, 

the  Commander,  Naval  Recruiting  Command  ( COMNAVCRUITCOM) ,  and 

the  Chief  of  Naval  Reserves  (CNAVRES)  and  must  be  maintained  when 

submitting  changes  to  any  class  schedules  or  quotas  for  students 

detailed  by  CHNAVPERS. 

Course  data  and  associated  class  data  are  reported 

whenever : 

•  a  new  course  is  established, 

•  a  new  fiscal  year  schedule  of  classes  is  added  to  an 
existing  course  contained  in  the  MCRF, 

•  a  new  class  is  added  to  an  existing  class  schedule 

(NOTE:  new  classes  inserted  within  an  existing  class 

schedule  will  disrupt  the  existing  class  number 
sequence.  Subsequent  classes  will  be  reported  with  new 
class  numbers  automatically), 

•  a  course  is  relocated  to  a  command  with  a  different 
Unit  Identification  Code  (UIC)  (NOTE:  forms  are  sub¬ 
mitted  to  establish  the  relocated  course  as  a  new 
course.  The  excess  class  schedule  of  the  old  course  is 
deleted  and,  when  enrolled  students  have  been  grad¬ 
uated,  the  old  course  is  deleted.  There  are  two 
exceptions : 

when  the  entire  training  activity  is  relocating, 
the  MCRF  requires  only  a  change  to  student  and 
staff  UICs ; 

when  the  individual  course  is  under  Naval  Air 
Maintenance  Training  Group  ( NAMTRAGRU )  responsi¬ 
bility,  the  relocation  requires  only  a  change  to 
student  UIC. 

Submissions  to  NITRAS  for  relocation  of  PRIDE  courses 
are  accomplished  sixteen  months  before  the  convening  of 
the  first  class  at  the  new  location.  For  non-PRIDE 
courses,  submissions  are  accomplished  five  months 
before  the  convening  date. 


•  a  revision  to  course  data  is  required, 

•  an  existing  class  needs  revision, 

•  a  course  is  deleted,  or 

•  a  class  is  deleted  from  an  existing  course  schedule. 

MCRF  forms  are  submitted  to  the  Chief  of  Naval 

Technical  Training  ( CNTECHTRA) ,  the  Commander  of  Training,  U.S. 

Pacific  Fleet  (COMTRAPAC),  or  the  Commander  of  Training,  U.S. 

Atlantic  Fleet  (COMTRALANT)  as  directed  by  the  MCRF  coordinator. 

Instructions  for  completion  of  these  forms  are  documented  in  a 

14/ 

previous  report. — 


b.  Student  Master  File 


The  Student  Master  File  (SMF)  provides  three  major 


functions : 


•  acting  as  the  central  point  of  collection  and  dissemi¬ 
nation  of  training-related  information  about  individual 
students  in  the  majority  of  formal  Navy  schools, 

•  maintaining  a  complete  history  of  actions  for  reported 
students  in  order  to  support  statistical  analyses  and 
special  studies  and  to  resolve  future  training  and 
information  needs,  and 

•  summarizing  reported  student  actions  to  support  the 
Training  Summary  File  (TSF)  and  other  management  infor¬ 
mation  systems. 

Students  are  reported  and  accounted  for  to  SMF  or 
TSF,  but  not  both,  from  the  time  that  they  arrive  on  board  the 
training  activity  until  the  day  that  they  leave  or  become  part  of 


14/  Rodney  D.  McConnell  and  Carolyn  G.  Jones,  Skill  Training 
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the  command's  staff.  For  the  purposes  of  SMF,  "student"  is  de¬ 
fined  as  any  individual  reporting  to  a  training  activity  for  the 
purpose  of  receiving  instruction  in  any  course  contained  in  MCRF 


which  meets  the  following  criteria: 

•  the  course,  regardless  of  length,  awards  a  Navy 
Enlisted  Classification  (NEC); 

•  the  course  does  not  award  a  NEC  code  but  is  twelve  cal¬ 
endar  days  on  more  in  length  ("calendar  days"  are 
defined  as  the  number  of  days,  including  holidays  and 
weekends,  that  expire  from  the  convening  date  to  the 
graduation  date.  Both  the  convening  date  and  the 
graduation  date  must  be  included  in  the  calendar  day 
count . ) ; 

•  the  course  is  less  than  twelve  calendar  days  in  length 
but,  when  combined  with  other  courses,  awards  an  NEC; 

•  the  course  includes  foreign  students;  or 

•  the  course  is  identified  by  an  Officer  Course  Code. 

Also  included  are  those  individuals  enrolled  in  recruit  and  ap¬ 
prenticeship  training  and  in  officer  candidate  acquisition  cour¬ 
ses,  which  report  to  the  Officer  Candidate  Acquisition  Reporting 
System  ( OCARS ) . 


Students  enrolled  in  programmed  instruction,  self- 
paced,  or  other  courses  of  variable  length  that  do  not  adhere  to 
set  convening  or  graduation  dates  are  treated  independently  and 
may  be  "classed-up"  on  a  weekly  basis.  To  allow  for  flexibility 
in  this  "classing-up"  of  students,  a  leeway  of  seven  days  before 
or  after  the  convening  or  graduation  dates  is  authorized.  The 
set  convening  and  graduation  dates  listed  in  MCRF  are  entered  on 
CNET  GEN  1510/2.  As  students  become  eligible  for  graduation, 
changes  are  submitted.  This  procedure  may  be  followed  for  up  to 


thirty  days  after  the  set  graduation  date  on  MCRF  for  courses 
designated  as  self-paced  or  Computer  Managed  Instruction  (CMI)  • 
To  support  the  automatic  availability  system,  exception  gradua¬ 
tion  dates  are  reported  as  soon  as  they  are  determined. 

In  the  event  that  an  individual  reports  to  a 
course  under  official  CHNAVPERS  orders,  but  is  ineligible  for 
enrollment  in  the  course,  the  error  is  immediately  reported  to 
CHNAVPERS  under  Article  12.26  of  the  Enlisted  Transfer  Manual. 
Course  entrance  requirements  are  listed  in  Chapter  12  of  the 
Enlisted  Transfer  Manual  and  in  the  Catalog  of  Navy  Training 
Courses  (CANTRAC).  The  student  who  does  not  meet  these  eligi¬ 
bility  requirements  is  enrolled  in  the  class,  as  ordered,  but 
with  a  Student  Action  Code  of  "C"  until  further  instructions  are 
received  from  CHNAVPERS. 

The  accuracy,  completeness,  and  timeliness  of  the 
data  of  the  SMF : 

•  provide  timely  information  by  social  security  number  of 
all  personnel  receiving  training  in  Navy  or  "Other 
Service"  courses  which: 

are  twelve  calendar  days  or  more  in  length, 

award  an  NEC  code  in  combination  with  other 

courses , 

are  identified  by  an  Officer  Course  Code,  or 

include  foreign  students; 

•  establish  an  automated  method  for  providing  training 
history  codes  or  NEC's  to  the  CHNAVPERS  for  updating 
the  New  Enlisted  System  (NES); 

•  contribute  to  the  enlisted  personnel  availability  sys¬ 
tem  by  transferring  availability  dates  to  the  NES; 
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•  supply  MCRF  and  TSF  with  summarized  student  statis¬ 
tics; 

•  provide  management  with  the  capability: 

to  measure  course  and  quota  utilization, 

to  monitor  attrition  and  setback  reasons,  and 

to  compare  trainee  input  with  established  Basic 
Test  Battery  ( BTB )  and  Armed  Services  Vocational 
Battery  (ASVAB)  score  entrance  requirements;  and 

•  provide  course  completion  information  for  selected 
officer  courses  to  CHNAVPERS. 

Instructions  for  completion  of  the  SMF  form  are  documented  in  a 
„  15/ 

previous  report. 

c .  Training  Summary  File 

The  Training  Summary  File  (TSF)  collects  statis¬ 
tical  summary  data  on  students  attending  courses  not  otherwise 
reported  to  the  Student  Master  File  (SMF).  For  NITRAS  purposes, 
"student"  is  defined  as  any  individual  reporting  to  a  training 
activity  for  the  purpose  of  receiving  instruction  in  one  of  the 
courses  contained  in  MCRF.  TSF  reports  training  statistics  for 
all  NITRAS  courses  by  interfacing  with  SMF,  which  collects 
training-related  information  on  each  student  by  name,  social 
security  number  (SSN),  and  service  category  and  by  every  student 
action  that  may  arise.  Specifically,  TSF  provides  the  capability 
to  monitor  the  average  on  board  (AOB)  congressional  training 
requirement.  The  CNET  GEN  1510/4  forms  are  used  to  update  the 
TSF. 
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An  example  of  a  TSF  output  is  shown  at  Exhibit 
IV-2 ,  NITRAS  Course  Summary.  The  CNET  Report  1500.1208,  Course 
Summary  by  Type  Course,  displays  student  enrollment  and  attrition 
and  set  back  percentages  by  each  course  offered  at  the  time  of 
the  report.  Courses  are  identified  by  type,  listed  at  Exhibit 
IV-3,  Course  Types,  by  course  identifying  number  (CIN),  by  course 
data  processing  (CDP)  code,  and  by  course  title. 

Instructions  for  completion  of  the  TSF  form  are 

,  ,  .  .  16/ 
documented  m  a  previous  report. — 

2 .  Marine  Corps  Training  System 

The  Marine  Corps  manages  training  at  the  headquarters 
level  and  does  not  have  a  training  command  as  do  the  other 
Services.  The  Marine  Corps  uses  other  Services’  training  for  a 
considerable  amount  of  individual  skill  training.  The  Navy  pro¬ 
vides  most  of  the  aviation  training  and  the  Army  a  substantial 
portion  of  combat  arms  training,  (e.g.,  armor  and  artillery 
training).  The  Deputy  Chief  of  Staff  (DCS)  for  Training  at  Head¬ 
quarters  Marine  Corps  is  responsible  for  all  Marine  Corps  train¬ 
ing. 

Training  guidance  is  prepared  and  issued  to  Marine 
Corps  commands  and  schools  by  the  DCS  Training.  Exhibit  IV-4  is 
a  schematic  of  major  Marine  Corps  individual  training  facilities. 
One  or  more  schools  is  located  at  each  location  shown. 
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Exhibit  IV-2 .  NITRAS  COURSE  SUMMARY 


TYPE  COURSE 


Class  "A"  -  Provide  Che  basic  technical  knowledge  and  skills  required  to 
prepare  for  job  entry  level  performance  and  further  specialized  training. 
Includes  apprenticeship  training.  An  NEC,  NOBC,  MOS,  or  AFSC  may  be  awarded 
to  identify  the  skill  achieved.  Also  includes  some  officer  courses  such 
as  Communication  Officer,  ASW  Officer,  etc. 


AA 

AO 

AP 

A1 

A2 

A3 

AA 

A5 

A6 


Apprenticeship  Training 

Officer  Preparatory  Schools  not  associated  with  professional  develop¬ 
ment  programs. 

Enlisted  Preparatory  Schools. 

Initial  Skill  Training  -  Enlisted. 

Initial  Skill  Training  -  Officer. 

Initial  Skill  Training  -  Enlisted  Communications  Program  3. 

Initial  Skill  Training  -  Officer  Communications  Program  3. 

Initial  Skill  Training  -  Enlisted  Medical. 

Initial  Skill  Training  -  Officer  Medical. 


Class  "C"  -  Provide  the  advanced  knowledge,  skills  and  techniques  to  perform 
a  particular  Job  in  a  billet  and/or  any  course  which  awards  or  is  a  pre¬ 
requisite  to  a  skill  awarding  course;  i.e.,  NEC,  NOBC,  MOS  or  AFSC,  or  is 
thirteen  calendar  days  or  longer  and  does  not  conform  to  the  definition  of  a 
Class  "A"  course. 


Cl 

Skill 

Progression  Training 

C2 

Skill 

Progression  Training 

C3 

Skill 

Progression  Training 

CA 

Skill 

Progression  Training 

C5 

Skill 

Progression  Training 

C6 

Skill 

Progression  Training 

CX 

Skill 

Progression  Training 

-  Enlisted. 

-  Officer. 

-  Enlisted  Communications  Program  3. 

-  Officer  Communications  Program  3. 

-  Enlisted  Medical. 

-  Officer  Medical. 

-  Officer  Medical  (Residency  Only) 
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C7  Specialized  Progression  Training  for  advanced  paygrades:  Enlisted 
personnel  normally  paygrade  E-5  and  above. 

Class  "E"  -  Programs  designed  to  provide  formal  professional  educational 
instruction  in  a  general  or  particular  field  of  study  which  may  lead  to  an 
academic  degree. 

El  Professional  Development  Education  -  Senior  Service  College. 

E2  Professional  Development  Education  -  Intermediate  Service  School. 

E3  Graduate  Education  for  Sub-specialty,  full  time,  funded  -  Degree 
Program. 

E4  Undergraduate  Education  -  Degree  Program. 

E5  Postgraduate  Education  (not  fully  funded)  -  Degree  Program. 

E6  Non-degree  Educational  Programs. 

E7  Health  Education  Programs. 

E8  Other  Education  Programs. 

Class  "F"  -  Provide  team  training  to  fleet  personnel.  Officers  and  enlisted, 
who  normally  are,  or  are  enroute  to  duty  as  members  of  ship's  companies 
and/or  individual  training  such  as  refresher,  operator,  maintenance  and  tech¬ 
nical  training  of  less  than  13  calendar  days  established  to  meet  the  needs 
of  the  fleet  or  type  commanders.  A  NEC,  NOBC,  MOS  or  AFSC  will  not  be 
awarded . 

FI  Functional  Training  -  Enlisted. 

F2  Functional  Training  -  Officer. 


Class  "P"  -  Officer  acquisition  programs  designed  to  provide  undergraduate 
education  and/or  Indoctrination  and  basic  training  in  fundamentals,  pre¬ 
liminaries,  or  principles  to  midshipmen,  officer  candidates,  and  other 
newly  commissioned  officers  (except  those  acquired  through  Class  "V"  programs) 

PA  NESEP 

PB  Health  Profession  Acquisition  Military  Programs. 

PC  Other  Programs. 
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PD  Preparatory  School. 

PI  Officer  Acquisition  Training  (Academy). 

P2  NROTC. 

P3  JNROTC. 

PA  AVROC  II. 

P5  ROC. 

P6  OCS. 

P7  AOC  (Pre-conmlssioning) . 

P8  MFOL  (Pre-commissioning) . 

P9  NUPOC-S 

Class  "R"  -  Training  upon  initial  enlistment  or  induction  which  provides 
the  general  indoctrination  and  prepares  the  recruit  for  early  adjustment  to 
military  life  by  providing  skill  and  knowledge  in  basic  military  subjects. 
NOTE:  DOES  NOT  INCLUDE  APPRENTICESHIP  TRAINING. 

HI  Recruit  Training . 

Class  "V"  -  Provide  the  skills  which  lead  to  the  designation  of  Naval  Aviator 
or  Naval  Flight  Officer. 

VI  Undergraduate  NASC/PRIM  Flight  Training. 

V2  Undergraduate  Flight  Training  -  PROP. 

V3  Undergraduate  Flight  Training  -  JET. 

V4  Undergraduate  Flight  Training  -  HELO. 

V5  Undergraduate  NFO  Training. 
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PRINCIPAL  MARINE  CORPS  INDIVIDUAL  TRAINING  FACILITIES 
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Marine  Corps  Individual  Skill  Training  requirements  are 
prepared  as  part  of  the  annual  Training  Input  Plan  (TIP).  The 
TIP  is  a  compilation  of  formal  school  requirements  within 
Specialized  Skill  Training  for  Active  and  Reserve  Marine  Corps 
officers  and  enlisted  personnel.  It  includes  all  formal  Initial 
Skill,  Skill  Progression,  and  Functional  Training.  The  TIP  lists 
all  school  courses  and  programmed  officer  and  enlisted  quotas  by 
source:  Active,  Reserve,  Other  Service,  and  lateral  move 
(requiring  retraining  from  overage  skills). 

Initially,  Marine  Corps  training  requirements  are 


developed  by  use  of  the  Enlisted  Force  Management  System 
17/ 


( EFMS ) —  which,  using  a  program  called  Training  Output  Plan 
(TOP),  constructs  a  profile  for  each  Military  Occupational 
Specialty  (MOS)  within  each  Occupational  Field  (OCC  FLD)  .  The 
program  determines  the  optimal  training  output  required  to  sus¬ 
tain  each  MOS  and  OCC  FLD  and,  subsequently,  the  total  Marine 
Corps  on  the  basis  of  first  and  second  year  manning  requirements. 
The  primary  inputs  to  the  TOP  subroutine  are  career  force  MOS 
requirements  taken  from  the  Grade  Adjusted  Recapitulation  (GAR). 


The  GAR  is  produced  by  the  Simulator  for  Total  Requirements 

18/ 


Authorization  Forecast  and  Evaluation  (STRAFE)  model. —  The 
principal  output  is  the  "Yearly  Training  Output"  necessary  to 
support  GAR  requirements.  This  output  is  then  factored  using  the 


UJ  Enlisted  Force  Management  System  Enhanced  Functional  Speci- 
,  fication,  DCS  Manpower,  Headquarters  USMC,  l7  October  1980. 
A®./  STRAFE  User's  Guide,  DCS  Manpower,  Headquarters  USMC,  June 
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constraint  of  total  new  accessions  and  first  year  attrition.  The 
Training  Output  Plan  is  then  given  to  the  OCC  FLD  and  MOS 
specialists  for  a  comparison  with  actual  inventory  versus  man¬ 
power  requirements.  Manpower  requirements  are  based  on  author¬ 
ized  table  of  organization  positions  plus  or  minus  known  changes 
due  to  modernization,  activations,  inactivations,  and  any  other 
actions  in  process.  This  is  a  judgemental  process  assisted  by 
computerized  personnel  and  manpower  files.  Officer  training  is 
ascertained  in  the  same  manner.  Reserve  Component  training 
requirements  are  prepared  by  the  DCS  Reserve  Affairs  by  comparing 
expected  inventory  with  manpower  requirements. 

The  DCS  Training  translates  these  output  requirements 
into  input  requirements  in  the  TIP.  To  assist  in  this  process 
detailed  "training  tracks"  have  been  developed  for  every  OCC  FLD 
and  MOS  which  are  updated  yearly  for  preparation  of  the  TIP. 
Another  related  document  is  the  Field  Budget  Guidance.  This  is  a 
list  of  Marine  Corps  school  and  course  requirements  that  is  sent 
to  the  several  Marine  Corps  commanders  who  operate  the  USMC 
schools.  The  Field  Budget  Guidance  requests  the  schools'  recom¬ 
mended  class  schedules  based  on  the  TIP  projections  and  asks  for 
identification  of  any  training  needs  that  require  additional 
resources.  The  receipt  of  the  proposed  class  schedules  from  the 
schools  is  the  basis  for  issuance  of  the  Training  Quota  Memoran¬ 
dum  (TQM),  which  is  a  series  of  class  and  quota  issuances  that 
satisfy  the  Marine  Corps  training  requirements. 
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Marine  Corps  training  is  characterized  by  centralized 
control  and  decentralized  execution.  Headquarters  Marine  Corps 
provides  the  control  in  terms  of  establishing  what  schooling  will 
be  accomplished.  The  commanders  of  the  various  Marine  Corps 
schools  and  bases  are  responsible  for  the  curriculum  and  staffing 
of  the  schools  within  allowable  resources. 

B.  MAINTENANCE  DATA  SYSTEM 

The  Navy  and  Marine  Corps  both  maintain  aviation  maintenance 
information  on  the  same  system.  This  system,  which  is  the  Avia¬ 
tion  Maintenance  Material  Management  (3-M)  system,  is  maintained 
by  the  Navy  Ship  Parts  Control  Center  (SPCC).  The  Navy  Aviation 
3-M  system  is  described  in  detail  in  this  section.  The  system  is 
very  similar  to  the  Air  Force  MDC  system  that  was  described  in 
Section  II  of  this  report.  The  Aviation  3-M  system  has  an 
advantage  to  the  analyst  over  the  Air  Force  MDC  system  in  that 
the  automated  data  is  centrally  processed.  Data  can  be  accessed 
for  any  number  of  units  or  work  centers  by  submitting  a  request 
to  the  central  agency,  the  Navy  Maintenance  Support  Office 
(NAMSO)  Department  of  SPCC. 

The  type  of  data  reported  by  the  Aviation  3-M  system  pro¬ 
vides  the  potential  for  assessing  maintenance  performance  in  a 
manner  that  reflects  on  training  effectiveness.  That  is,  the 
data  address  the  questions  of  what  equipment  was  maintained,  what 
was  wrong,  what  was  done,  how  long  did  it  take,  and  who  did  the 


work. 


The  equipment  on  which  maintenance  is  performed  is  identi¬ 


fied  through  the  combination  of  the  weapon  end-item  (e.g.,  P-3 
Aircraft)  and  the  work  unit  code  (WUC)  structure  defined  for  that 
end-item.  The  detail  embodied  in  the  WUC  structure  typically  can 
be  identified  with  a  narrow  skill  area  related  to  specific  train¬ 
ing  programs. 

Describing  what  was  done  in  the  maintenance  of  equipment  is 
documented  by  type  maintenance  and  action  taken.  This  combina¬ 
tion,  performed  by  each  work  center  involved  in  a  maintenance 
action,  comprises  a  maintenance  task.  The  documentation  of  the 
maintenance  task  identifies  the  organization  performing  the  work 
to  include  the  work  center. 

This  section  has  two  subsections : 

•  Aviation  3-M  Systems  Operations,  and 

•  Maintenance  Data  Reports. 

1 .  Aviation  3-M  System  Operation 

On  12  November  1982,  NAMSO  became  part  of  the  SPCC. 
All  Aviation  Maintenance  and  Material  Management  (3-M)  Informa¬ 
tion  System  functions  assigned  to  the  former  NAMSO  are  still  per¬ 
formed  by  NAMSO  Department  of  SPCC.  The  3-M  system  is  sponsored 
by  the  Chief  of  Naval  Operations  (CNO)  and  administered  through 
the  operating  chain  of  command.  Technical  support  is  provided  by 
the  Chief  of  Naval  Material  (CNM)  and  the  Naval  Air  Systems 
Command  (NAVAIR)  for  both  Navy  and  Marine  Corps  aircraft. 


NAMSO  maintains  the  central  data  bank  for  aviation  3-M 
data  and  produces  the  Management  Information  Reports  distributed 
throughout  the  Naval  establishment.  These  reports  are  available 
to  any  Navy  activity  upon  request  through  the  proper  channels. 
To  discuss  data  requirements,  direct  liaison  is  encouraged  by 
NAMSO,  Code  8611,  Autovon  430-2031;  commercial  (717)  790-2031. 
Reports  are  available  in  hardcopy,  microfilm,  or  microfiche. 
Most  recurring  reports  are  in  hardcopy  form.  If  a  microfilm  or 
microfiche  medium  is  requested,  the  entire  report  is  given.  On 
special  request,  NAMSO  may  prepare  extracts  in  other  formats, 
such  as  magnetic  tapes  or  machine  cards.  End  users  are  to  tele¬ 
phone  before  submitting  requests  for  information  in  any  format 
other  than  hardcopy,  microfilm,  or  microfiche. 

The  Maintenance  Data  System  (MDS)  has  been  developed  as 
an  integral  part  of  the  3-M  system  for  purposes  of  data  collec¬ 
tion  and  reporting.  Basic  data  generated  by  maintenance  per¬ 
sonnel  are  documented  and  distributed  to  interested  activities. 
Data  are  processed  according  to  the  following  categories. 

•  Maintenance  Data  System  (MDS): 

Maintenance  Data  Reporting  (MDR) ; 

Subsystem  Capability  Impact  Reporting  (SCIR); 

Material  Reporting  (MR); 

Aircraft  Utilization  (AU);  and 

Training  Device  Utilization  (TDU); 

•  Depot  Data : 

Technical  Directive  Compliance  (TDC )  Data;  and 

Summary  Maintenance  Action  and  Cost  Data  on 
Aircraft  and  Engines. 


IV-22 


Standardized  procedures  simplify  maintenance  management  func¬ 


tions,  reporting  procedures,  and  training  of  personnel.  Stan¬ 
dardized  forms,  administrative  paperwork,  organizational  work 
center  codes,  reports,  and  control  documents  make  documentation 
efforts  much  less  time-consuming  and  demanding  at  all  levels. 
Data  elements  are  standardized  within  the  MDS  in  a  common,  under¬ 
standable  language  readily  adaptable  to  electronic  data  proces¬ 
sing  techniques.  This  allows  activities  to  conduct  inspections 
peculiar  to  the  assigned  mission  as  the  result  of  equipment 
configuration,  operating  requirements,  or  environmental  condi¬ 
tions  . 

Data  flow  through  three  distinct  but  related  cycles: 

•  the  local  cycle,  organizational  and  intermediate  levels 
of  maintenance; 

•  the  local-central  cycle,  between  the  local  activity  and 
NAMSO;  and 

•  the  central-external  cycle,  between  NAMSO  and  the 
various  systems  commands,  offices,  and  commands  other 
than  the  originating  command. 

These  cycles  are  depicted  by  Exhibit  IV-5,  Aviation  3-M  Data 
Flow. 

In  the  local  cycle,  the  best  source  of  information  is 
the  individual  worker.  When  the  maintenance  task  is  completed, 
the  worker  submits  a  completed  Visual  Information  Display  System/ 
Maintenance  Action  Form  (VIDS/MAF),  shown  at  Exhibit  IV-6,  to  his 
supervisor.  The  supervisor,  the  petty  officer  or  non-commis¬ 
sioned  officer  responsible  for  the  shop  or  work  center,  reviews 
the  form  for  accuracy  and  completeness.  The  source  documents  are 
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Exhibit  IV- 5 .  AVIATION  3-M  DATA  FLOW 


No.  QPF7103 


COPY  1 


WORK  CENTER  REGISTER.  CONTROL  AND  PROCESSING  COPY 
VIDS/MAF  OFNAV  4790  60  (RfV  2-82]  S  'N  01 07LF-047  9304 


5  PART  FORM  ||  ENTRIES  REQUIRED  SIGNATURE 

USE  BALL-POINT  PEN  PRESS  HARD 


ONI  LOGS  REC 

□  □□ 


ACCUMULATED  WORK  HOURS  II  ACCUMULATED  AWM  HOURS 

NAME/SMIFT  TOOL  DATE  MAN  HOURS  ELAPSED  M/T  It  DATE  TIME _ WASON  HOURS 


PUS  GOVERNMENT  PRINTING  OFFICE  1M4  -  70S  STS 

Exhibit  IV-6 .  VIDS/MAF  FORM 
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then  forwarded  to  Maintenance  Control  for  screening.  An  analyst 
corrects  all  of  the  source  documents  from  Maintenance  Control  and 
delivers  them  to  the  Data  Services  Facility  (DSF)  of  the  support¬ 
ing  ship  or  station.  The  DSF  converts  the  data  from  the  source 
documents  to  a  machine-sensible  medium  such  as  punched  cards, 
discs,  or  tapes.  Any  questionable  data  are  returned  to  the  ori¬ 
ginating  unit  for  correction  or  clarification.  Machine  listings 
of  data  are  printed  on  a  daily  or  as-specified  frequency  for  the 
use  of  the  originating  units.  Machine-sensible  data  are  retained 
by  the  DSF;  source  documents  are  returned  to  the  originating 
units . 

In  the  local-central  cycle,  local  data  services  units 
mail  duplicate  record  files  to  NAMSO ,  where  the  data  are  combined 
with  those  of  all  other  reporting  units.  Machine  runs  identify 
discrepancies,  which  are  then  returned  to  the  originating  units 
for  correction. 

In  the  central-external  cycle,  the  central  data  pro¬ 
cessing  activity  is  responsible  for  providing  data  to  agencies 
higher  in  the  command  management  chain.  These  include  CNO,  Fleet 
and  Type  Commanders,  Systems  Commands,  System  Command  field 
agencies,  contractors,  and  others  depending  on  factual,  compre¬ 
hensive  maintenance  data  as  a  basis  for  sound  command  or  manage¬ 
ment  decisions.  Report  requirements  are  established  by  mutual 
decisions  made  by  NAMSO  and  the  agency  concerned. 


Maintenance  Data  Reports 


Maintenance  Data  Reports  (MDR's)  are  designed  to  pro¬ 
cess  variable  data  sequences  and  to  display  any  combination  of 
Visual  Information  Display  System/Maintenance  Action  Form  (VIDS/ 
MAP)  functional  segments.  This  permits  the  generation  of  reports 
tailored  to  the  needs  of  the  individual  users.  The  data  elements 
are  collected  from: 

•  the  VIDS/MAF  form,  OPNAV  4790/60,  shown  at  Exhibit 
IV-6,  and 

•  the  Support  Action  Form,  OPNAV  4790/42,  shown  at  Ex¬ 
hibit  IV-7 . 

The  selection  parameters  are  specified  by  the  intended  user,  for 
example: 

•  type  equipment, 

•  organizations, 

•  work  unit  code  (WUC), 

•  data  range,  and 

•  record  types. 

A  sample  page  from  an  MDR  is  shown  at  Exhibit  IV-8.  The  data 
were  developed  using  the  following  parameters: 

•  P-3  aircraft, 

•  Action  Organizations  whose  first  positions  are  A  (At¬ 
lantic)  or  P  (Pacific), 

•  WUCs  beginning  with  14  (flight  controls). 

The  data  elements  that  comprise  the  MDR  are  discussed 
in  the  order  in  which  they  appear  on  the  form: 
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CT 


*  MAINT. 
LEVEL 

l-OK 

1-INT. 

*-0€* 


SUPERVISOR 


•nMioi-ir-Mi-Mio 


SUPPORT  CODES 


TYPE  MAINTENANCE  CODES 


OPERATIONAL  SUPPORT 

cleaning  /depre  servation 

INSPECTION  (EXCLUDES  CORROSIONI 
CORROSION  PREVENTION  (MISC.) 

041  AIRFRAME /ENCLOSURES  045  ELECTRO 

042  POWER  PLANTS  046  PHOTOGR 

045  PROPELLERS/HELICOPTER  04T  ARMAMC* 

DYNAMIC  COMPONENTS  046  SAFETY/ 

044  UTILITIES  049  PRESERVi 

GENERAL  FUNCTIONS 

ENGINE  RUILOuP,  TEAROOWN.  TEST  STAND  OPERATION 
MISSION  SHOP  SUPPORT 

INSPECTION  OF  AVIATORS'  EQUIPMENT,  SAFETY  AND 
SURVIVAL  EQUIPMENT 
NON-AERONAUTICAL  WORK 


ELECTRONICS/ELECTRICAL 

PHOTOGRAPHIC 

ARMAMENT/ORONANCE 

SAFETY/SURVIVAL 

PRESERVATION 


GENERAL  SUPPORT 
TURNAROUND,  PREFLIGHT. 
PREOPCRATIONAL.  OR 
PRELAUNCH  INSPECTION 
f'AILY,  DAILY/POSTFLIGHT, 

OR  POSTOPERATIONAL 
INSPECTION 

TRANSIENT  MAINTENANCE 
LOCAL  MANUFACTURE 
SUPPLY  SUPPORT 

reclamation  and  salvage 


Exhibit  IV- 7 .  SUPPORT  ACTION  FORM 
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Exhibit  IV- 8 .  SAMPLE  MAINTENANCE  DATA  REPORT 


•  Job  Control  Number  (JCN)  -  nine  to  eleven  alpha/ 
numeric  characters  allowing  for  separate  identification 
of  each  maintenance  action.  The  JCN  is  composed  of 
four  parts: 

Organization  Code  -  three  alpha/numeric  characters 
identifying  the  organization  that  originally  as¬ 
signs  a  JCN  to  a  maintenance  action.  Reference: 
Organizational  Code  Master  Listing  Report  Number 
NAMSO  4790 .A7 06 5-01 . 

Day  -  three  numeric  characters.  Part  of  the 
Julian  date  specifying  the  day  of  the  year  that 
the  JCN  was  assigned.  This  does  not  necessarily 
reflect  the  date  on  which  work  was  actually 
begun. 

Serial  Number  -  three  alpha/numeric  characters 
running  sequentially  from  001  to  999  or  from  A01 
to  Z99.  If  there  are  more  than  Z99,  use  alpha 
characters  in  the  second  and  third  positions  until 
ZZZ.  When  999  or  ZZZ  has  been  assigned,  the  next 
number  in  sequence  is  again  001  or  A01.  Do  not 
use  alphabetic  first  characters  when  documenting 
preflight,  postflight,  turnaround,  daily,  special, 
conditional,  corrosion,  or  acceptance/transfer 
inspections . 

Suffix  -  a  structured  alpha/numeric  code  identify¬ 
ing  a  sub-assembly  or  sub-subassembly  repair 
action  independent  of  the  major  component  repair. 
This  is  used  for  intermediate-level  maintenance 
functions  regardless  of  where  the  maintenance  is 
being  performed.  The  double-suffix  logic  is  as 
follows : 


First  Position 

Second  Position 

Description 

Alpha 

Blank 

A  reparable  subassembly 
which  contains  reparable 
sub-subassemblies . 

Alpha 

Alpha 

A  reparable  sub-subas- 
sembly  removed  from  a 
reparable  subassembly. 

Numeric 

Alpha 

A  reparable  subassembly 
with  no  reparable  assem¬ 
blies  . 
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•  Type  Equipment  Code  (TEC)  -  four  alpha/numeric  char¬ 
acters  identifying  the  complete  end-item  or  category  of 
equipment  being  maintenanced .  A  complete  listing  may 
be  found  in  all  applicable  WUC  manuals.  Reference: 
Aviation  Type  Equipment  Code  List,  Report  Number  NAMSO 
4790 . A7210-01 .  For  example,  APBD  represents  the  P-3. 

•  Bureau/Serial  Number  -  identifies  a  specific  end-item 
of  component .  This  number  is  assigned  by  the  manufac¬ 
turer  to  differentiate  between  a  particular  end-item  or 
component  and  others  of  the  same  type,  model,  series, 
or  design. 

•  Action  Organization  -  three  alpha /numeric  characters 
identifying  the  location  of  the  maintenance  organiza¬ 
tion.  For  example,  P9G  represents  Moffett  Naval  Air 
Station  (NAS). 

Additional  entries  for  the  same  JCN  begin  in  this 
column.  Each  interval  is  specifically  identified  as: 

RCV  Received 

INW  In-Work 

JS3  through  JSO  Job  Status  3  through  10 

COM  Completed 

AWM  Awaiting  Maintenance 

Each  interval  consists  of: 

the  Job  Status,  indicated  by  "M"  for  Maintenance 
or  "S"  for  Supply; 

the  date  that  work  was  begun; 

the  time  that  work  was  begun; 

the  hours  by  the  clock  that  the  work  was  in  pro¬ 
cess;  and 

the  Equipment  Operational  Capability  (EOC). 

A  letter  recorded  before  the  "RCV"  interval  indicates: 

S  Subsystem  Capability  and  Impact  Reporting 
(SCIR) -related  maintenance  action; 

V  SCIR-related  event  containing  erroneous  data 
(invalid  date-time,  EOC  code,  etc.);  or 
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SCIR-related  event  is  invalid  because  the 
event  does  not  begin  and  end  within  the  same 
month . 


Work  Center  (WC)  Code  -  three  alpha/numeric  characters 
identifying  the  work  center  performing  the  action  doc¬ 
umented,  as  follows: 

Intermediate  Level 


41  L  T56  Engine  Shop 

51  D  Machine  Shop 

52  0  Hydraulics/Pneumatics  Branch 

62  A  Electric  Shop 

41  I  Jet  Engine  Component  Repair  Shop 

05  A  Matricial  Screening  (AMSU), 

also  at  organizational  level 


Organizational  Level 


51  A 
51  C 
45  O 
53  O 


Structures  Shop 

Welding  Shop 

Test  Cell  Branch 

Nondestructive  Inspection  (NDI) 

Branch,  also  at  Intermediate  Level 


Reference:  Appendix  F,  Volumes  2  or  3,  OPNAVINST 

4790. 2B. 


Maintenance  Level  (ML)  -  identifies  the  level  of  main¬ 
tenance  actually  being  performed,  not  necessarily  the 
level  assigned  to  the  activity.  Reference:  Chapter  1, 
Volume  1,  OPNAVINST  4790. 2B. 


Action  Date  -  five  numeric  characters.  Julian  date 
that  work  actually  was  begun. 

Work  Unit  Code  (WUC)  -  one,  three,  five,  or  seven 
alpha/numeric  characters  identifying  the  system,  sub¬ 
system,  set,  major  component,  reparable  sub-assemblies, 
or  part  of  the  item  being  maintained.  These  codes  are 
assigned  and  controlled  by  the  Naval  Air  Technical 
Services  Facility  ( NAVAI RTECHSERFAC )  under  the  direc¬ 
tion  of  Naval  Air  Systems  Command  ( NAVAI RSYSCOM )  and 
published  in  WUC  manuals  for  end-items  in  three  major 
categories : 

type/model/series  for  aircraft,  drones,  and  mis¬ 
siles  ; 


aircraft  flight/ tactical  trainers?  and 


aeronautical  support  equipment. 


WUC  *  s  from  these  manuals  are  used  to  code  maintenance 
actions  on  an  end-item  and  its  components. 

When  Discovered  (WD)  Code  -  single  alpha  character 
identifying  when  the  need  for  maintenance  was  discov¬ 
ered.  These  apply  to  the  VIDS/MAF  only.  Three  sets  of 
WD  codes  cover  the  equipment  categories: 

-  Aircraft  and  Engines; 

Ground  Support  Equipment;  and 

-  Missiles  and  Missile  Targets. 

Type  Maintenance  (TM)  Code  -  single  alpha/numeric  char¬ 
acter  describing  the  type  of  work  being  accomplished. 

Action  Taken  (AT)  Code  -  single  alpha/numeric  character 
describing  the  action  accomplished  on  the  item  identi¬ 
fied  by  the  WUC. 

Malfunction  Description  Code  -  three  alpha/numeric 
characters  describing  the  malfunction  which  required 
the  maintenance  action.  Conditional  malfunction  refers 
to  a  malfunction  other  than  material  failure,  for  ex¬ 
ample:  battle  damage,  improper  maintenance  or  hand¬ 
ling,  or  malfunction  of  associated  equipment. 

Manufacturer's  ( MFGR )  Code  -  five  alpha/numeric  char¬ 
acters  identifying  the  manufacturer  of  the  end  item, 
component,  or  part.  Reference:  Handbooks  H4-1  and 
H4-2  published  by  Defense  Logistics  Services  Center, 
Battle  Creek,  Michigan. 

Technical  Directive  Code  -  twelve  or  thirteen  alpha/ 
numeric  characters  identifying  a  specific  technical 
directive  by  type,  number,  revision,  amendment,  part, 
and  kit  number. 

Part  Number  -  identifies  an  item  of  production  or  a 
range  of  Items  of  production  by  the  manufacturer  con¬ 
trolling  the  design,  characteristics,  and  production  of 
the  item  by  means  of  its  engineering  drawing,  specifi¬ 
cations,  and  inspection  requirements. 

Serial  Number/Reference  Symbol  -  the  serial  number  of 
the  part  or  item  actually  being  repaired.  This  number 
is  usually  assigned  by  the  manufacturer  or  the  Navy  and 
identifies  the  specific  component  of  a  particular 
end-item. 
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•  Time/Circles  -  identifies  the  Julian  date  and  clock 
time  that  work  on  the  item  ceased. 

•  Removed  or  Received  Date  -  identifies  the  Julian  date 
that  the  malfunctioning  part  was  removed  from  the 
end-item  or  received  at  the  maintenance  activity. 

•  Data  Processing  Center  (DPC)  -  three  alpha/numeric 
characters  identifying  the  center  responsible  for  pro¬ 
cessing  the  data.  For  example,  P9G  refers  to  Moffett 
NAS . 

•  Items  Processed  (IP)  -  identifies  the  number  of  times 
that  the  action  indicated  by  the  Action  Taken  Code  was 
applied  to  the  item  identified  by  the  WUC.  For  exam¬ 
ple,  replacement  of  five  fuel  nozzles  is  documented  as 
five  IP;  replacement  of  several  transistors  in  an  elec¬ 
tronic  assembly  is  documented  as  one  IP. 

•  Man-hours  -  identifies  the  total  number  of  man-hours 
expended  by  assigned  personnel  to  complete  the  work 
described  on  the  source  document.  Hours  and  tenths 
multiplied  by  the  number  of  men  working  equals  total 
man-hours . 

•  Elapsed  Maintenance  Time  (EMT)  -  identifies  the  actual 
clock  time  in  hours  and  tenths  that  maintenance  was 
being  performed. 

•  Transaction  (TR)  Code  -  two  numeric  characters  identi¬ 
fying  the  type  of  data  being  reported.  A  second  entry 
in  this  column  identifies: 

G  installed  item 

-  E  removed  item 

H-Z  failed  parts 

(NOTE:  failed  parts  and  awaiting  parts 

(AWP)  indicators  are  displayed  in  the  WD 
and  TM  columns,  respectively.) 


C.  SUMMARY  OF  ANALYSIS 

Currently,  training  effectiveness  is  primarily  measured  by 
student  achievement  at  school.  The  ultimate  effectiveness  of 
training,  however,  is  determined  by  the  performance  of  personnel 


on-the-job.  Since  the  Navy  maintains  large  data  files  for  train¬ 
ing  and  maintenance,  it  may  be  possible  to  associate  the  perfor¬ 
mance  of  organizations  or  individuals  with  different  levels  and 
methods  of  training.  This  is  not  done  now,  due  to  constraints  on 
the  data  developed  through  the  NITRAS  and  3-M  systems  and  due  to 
features  of  the  maintenance  activities  themselves. 

The  NITRAS  and  3-M  systems  were  designed  to  assist  in  the 
management  of  training  and  maintenance,  not  in  the  evaluation  of 
personnel  performance.  An  assessment  of  training  effectiveness 
must  be  based  on  comparisons  of  performances  of  personnel  on 
similar  maintenance  operations.  Where  personnel  are  trained  in 
the  same  skill  area,  comparisons  are  made  between  different 
levels  and  methods  of  training.  These  conditions  place  a  series 
of  constraints  on  the  data  developed  through  the  management 
systems,  as  follows: 

•  The  data  must  measure  the  outcome  of  maintenance  opera¬ 
tions  in  terms  that  provide  a  criterion  of  maintenance 
personnel  performance. 

•  The  data  must  provide  unambiguous  (i.e.,  coded)  answers 
to  four  questions  regarding  each  maintenance 
operation : 

What  equipment  was  maintained? 

Why  was  maintenance  required  (i.e.,  the  nature  of 
the  equipment  malfunction)? 

What  was  done  to  it  (i.e.,  the  nature  of  mainte¬ 
nance  performed)? 

Who  performed  the  maintenance? 

•  The  data  must  separately  document  discrete  and 
well-defined  maintenance  tasks  that  are  comparable 
whenever  they  are  performed  on  the  same  subsystem  or 
assembly  (black  box)  installed  on  the  same  model  of 
equipment  end-items. 


•  The  data  must  identify  the  equipment  maintained  at  a 
sufficiently  low  level  (e.g.,  subsystem  or  assembly)  so 
that  it  can  be  associated  with  a  single  skill  area 
related  to  specific  training  programs. 

•  The  data  must  encompass  a  sufficiently  wide  set  of 
maintenance  tasks  to  provide  a  representative  sample  of 
the  on-the-job  skill  requirements  of  a  particular  skill 
area. 

•  The  data  must  identify  organizations  (or  individuals) 
performing  maintenance  in  a  way  that  will  allow  their 
association  with  skill  areas  that  can  be  related  to 
specific  training  programs. 

Methods  may  be  developed  by  which  a  representative  sample 
meets  all  of  the  above  requirements,  but  there  are  four  features 
of  maintenance  activity  that  are  additional  constraints  on  the 
assessment  of  training  effectiveness: 

•  Maintenance  tasks  may  be  performed  by  a  group  of  per¬ 
sonnel  (i.e.,  team  maintenance). 

•  Maintenance  tasks  associated  with  one  skill  area  may  be 
performed  by  personnel  trained  in  a  different  skill 
area  (i.e.,  cross-skill  maintenance). 

•  Maintenance  organizations  may  not  be  further  structured 
into  skill-related  work  centers. 

•  Not  all  military  end-items  or  their  installed  subsys¬ 
tems  are  built  to  standard  configurations. 

Maintenance  reporting  systems  may  be  modified  to  identify  the 
tasks  on  which  these  constraints  occur.  The  effectiveness  of 
training  on  the  maintenance  tasks  not  associated  with  these  con¬ 
straints  could  then  be  assessed. 

Careful  screening  of  the  maintenance  and  training  data  may 
leave  a  sample  of  personnel  and  tasks  that  are  not  affected  by 


the  above  constraints.  This  introduces  the  most  important  ques¬ 
tion:  is  the  sample  representative  of  Navy  maintenance  training 

effectiveness  as  a  whole? 

Although  it  is  feasible  to  use  NITRAS  and  3-M  system  data  to 
establish  a  link  between  training  and  maintenance,  it  would  be 
necessary  to  gather  information  at  the  local  level  similar  to 
what  was  done  for  the  Air  Force  data.  The  following  example. 
Exhibit  IV-9,  is  the  training  pipeline  for  Navy  Aviation  Elec¬ 
tronics  Technicians  (AT)  and  includes  the  following  information: 

•  course  identifying  number  (CIN)  -  identifies  the  com¬ 
mand  sponsoring  the  course,  the  DoD  skill  for  which  the 
course  trains,  and  the  sequence  number  of  the  course  of 
instruction  (which  may  be  conducted  at  multiple  loca¬ 
tions  ) ; 

•  course  title; 

•  length  of  course  in  weeks  (wks); 

•  actual  average  attrition  rate  for  FY82 ; 

•  course  data  processing  (CDP)  code  -  uniquely  identifies 
a  course  at  a  particular  training  activity; 

•  monthly  quantity  of  students  Under  Instruction  (UI)  - 
computed  as  the  actual  number  of  man-days  represented 
by  students  UI  during  the  month  (May  1982)  divided  by 
the  number  of  days  in  the  month;  and 

•  monthly  quantity  of  students  of  Awaiting  Instruction 
(AI)  -  computed  as  the  actual  number  of  man-days  repre¬ 
sented  by  students  AI  (unavoidable  and  excess)  during 
the  month  (May  1982)  divided  by  the  numbers  of  days  in 
the  month. 

This  training  pipeline  was  developed  by  interviewing  detailers  at 
the  Navy  Military  Personnel  Center  and  examining  NITRAS  reports 
and  the  Catalog  of  Navy  Training  Courses. 


Exhibit  IV- 9 .  NAVY  AVIATION  ELECTRONICS  TECHNICIAN  (AT) 

RATING  TRAINING  PIPELINE 


All  courses  listed  in  Exhibit  IV-9,  except  Recruit  Training 
and  Class  "C"  School  courses,  are  located  at  the  Naval  Aviation 
Technical  Training  Center  (NATTC)  in  Memphis,  Tennessee.  Upon 
arrival  at  NATTC,  all  recruit  graduates  attend  a  three-day  orien¬ 
tation  course.  Three  of  the  Initial  Skill  Training  courses  are 
self-paced: 

•  two  Class  “A"  School  Preparatory  courses: 

Aviation  Fundamentals  (AFUN),  and 

Basic  Electricity  and  Electronics  ( BE&E ) ;  and 

•  one  Class  "A"  School  course: 

Avionics  Technician  (AVA) . 

Hence,  the  course  lengths  shown  in  Exhibit  IV-9  are  average 
figures,  not  actual.  The  AI  figures  indicate  no  serious  backlogs 
exist  at  this  time;  the  low  values  appear  to  imply  unavoidable  AI 
and  minimal  excess  AI  backlog. 

Examination  of  local  personnel  and  training  records  and  com¬ 
parison  with  appropriate  training  pipelines  affords  a  picture  of 
individual  training  status.  Using  this  information,  overall  work 
center  training  status  can  be  ascertained. 

The  linkage  with  work  center  maintenance  performance 
requires  the  usage  of  maintenance  data  requested  from  NAMSO  for 
the  applicable  aircraft  and  WUC.  For  example,  ATs  perform  the 
maintenance  on  avionics  material  (WUC  14000).  Thus,  requesting  a 
listing  of  all  WUC  14000  task  performance  for  a  specified  period 
and  work  centers  allows  the  establishment  of  an  analytical  pro¬ 
cess  with  the  training  status  of  the  work  centers.  MCR  requested 


NAMSO  maintenance  data  by  work  center  for  selected  aircraft  and 
WUCs  for  the  month  of  April  1984.  The  report  showed  that  work 
center  data  was  available  in  a  usable  form  for  analysis  of  pro¬ 
ductivity.  Exhibit  IV-8  is  an  example  of  this  output. 

In  this  manner,  a  linkage  may  be  established  between  train¬ 
ing  and  maintenance.  As  there  is  no  central  data  system  for  per¬ 
sonnel  training  files,  the  analyst  must  examine  individual 
records  in  the  administrative  section  of  the  Aircraft  Intermedi¬ 
ate  Maintenance  Detachment  (AIMD)  or  flying  squadron.  A  typical 
training  path  must  be  determined  for  the  personnel  involved  in 
the  performance  of  a  particular  maintenance  action  and  the  effec¬ 
tiveness  of  the  maintenance  related  to  the  effectiveness  of  the 
training.  The  analysis  yields  the  training-maintenance  relation¬ 
ship  for  a  group  of  personnel  performing  a  particular  maintenance 
function  in  applicable  work  centers. 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  section  contains  conclusions  and  recommendations  abo 
how  Service  training  and  maintenance  data  systems  may  be  used  for 
analytical  purposes.  The  Services  are  discussed  separately  in  the 
following  order: 

•  Air  Force, 

•  Army,  and  the 

•  Navy  and  Marine  Corps. 

A.  AIR  FORCE 

Our  conclusion  concerning  Air  Force  training  and  maintenance 
data  systems  is  that  they  lend  themselves  readily  to  the  analysis 
of  maintenance-related  training.  MCR  analyses  developed  linkages 
between  training  and  maintenance  and  showed  how  such  analyses 
could  be  performed. 

We  recommend  some  improvements  to  maintenance  data  collection 
that  could  benefit  the  current  system  and  assist  analysis  at  the 
wing  level.  The  first  would  be  the  entry  of  employee  number  for 
all  maintenance  crew  personnel  in  the  maintenance  data  collection 
system.  This  would  allow  direct  and  precise  measurements  of 
training  and  productivity  for  individuals  and  work  centers.  A 
second  improvement  would  be  a  greater  use  of  component  level 
designation  for  maintenance  reporting  rather  than  system  or  sub¬ 
system  designation.  This  would  allow  more  refined  analyses  to  be 
performed  and  would  more  precisely  define  what  work  is  being 


done. 


B.  ARMY 

Our  conclusion  concerning  Army  training  and  maintenance  data 
systems  is  that  they  do  not  support  analyses  of  maintenance- 
related  training  as  currently  configured.  However,  the  Army  cen¬ 
tral  training  data  system  known  as  ATRRS  does  provide  some  in¬ 
formation  which  is  useful  for  other  analytical  purposes.  For 
example  the  ARPRINT,  which  specifies  detailed  course  and  class 
information,  can  be  used  for  comparison  with  available  resources 
by  Army  staff  agencies.  The  MMTR  input  report  is  a  particularly 
useful  report  sinct  it  provides  summary  detail,  by  category  of 
training,  including  inputs,  outputs,  and  training  loads.  The  MMTR 
input  report  can  also  be  used  for  comparative  purposes  with  avail¬ 
able  training  resources  at  a  higher  level  of  aggregation,  such  as 
total  Army  initial  skill  training. 

The  current  maintenance  data  base  known  as  TAMMS  does  not 
provide  information  useful  for  evaluating  maintenance  performance 
related  to  individual  skill  training.  Because  the  ability  to 
identify  and  track  individuals  is  central  to  any  methodology  for 
relating  maintenance  performance  to  training,  TAMMS  data  are  not 
appropriate  for  training  analysis. 

The  upcoming  SAMS  system  is  also  not  designed  for  training 
analysis  purposes;  no  information  that  identifies  individuals  is 
included  in  this  system.  The  system,  however,  is  still  in  pre¬ 
liminary  implementation  stages.  Data  elements  could  be  added  to 


the  system.  The  possible  inclusion  of  the  ARI-developed  MPS  with¬ 
in  SAMS  would  allow  training/productivity  analyses  to  be  deve¬ 
loped.  Even  if  individual  identification  were  not  included  in 
the  system,  the  improvements  in  accuracy  and  level  of  detail  over 
the  TAMMS  data  base  could  be  of  benefit  for  training/productivity 
analyses.  This  improvement  would  make  it  possible  to  perform 
comparable  analyses  in  the  Army  to  what  is  currently  practicable 
in  other  Services. 

We  do  not  have  any  specific  recommendations  concerning  Army 
data  bases.  Our  general  observation  is  that  current  Army  efforts 
may  provide  analytical  benefits  in  the  future. 


C .  NAVY  AND  MARINE  CORPS 

Our  conclusions  concerning  Navy  and  Marine  Corps  data  are  as 
follows : 

•  Navy  and  Marine  Corps  maintenance  data  is  centrally 
maintained  by  NAMSO ,  is  easily  accessible,  and  can  be 
requested  in  usable,  standard  formats  in  support  of 
analytical  efforts. 

•  Navy  training  data  is  maintained  centrally  on  all 
course  data;  it  is  easily  accessible,  and  can  be  re¬ 
quested  in  standard  report  formats.  The  files  are  par¬ 
ticularly  useful  in  providing  workload  data  for  exami¬ 
nation  of  resource  levels  (e.g.,  instructors).  The 
central  training  files  do  not  provide  individual  train¬ 
ing  data--this  must  be  obtained  at  the  installation 
level,  similar  to  the  Air  Force  but  with  one  main  dif¬ 
ference —  it  is  not  automated. 

•  Marine  Corps  training  data  is  maintained  centrally  by 
the  Office  of  the  DCS  Training,  Headquarters  USMC.  The 
Training  Input  File  (TIP)  contains  overall  training 
loads  by  skill  area.  "Training  tracks"  or  "pipeline" 
information  is  similarly  maintained. 

•  A  difficulty  with  examination  of  Navy  individual  train¬ 
ing  status  is  a  lack  of  consolidated  "pipeline"  infor¬ 
mation  on  specific  skills.  MCR  developed  the  pipeline 
for  aviation  electronic  technicians.  Others  would  have 


to  be  developed  similarly  for  any  skill  level 
analyses . 

We  recommend  that  specific  efforts  be  undertaken  in  order  to 
improve  the  use  of  these  data  for  analytical  purposes.  These 
efforts  should  include  the  following: 

•  Establish  linkages  between  specified  skills  and  related 
maintenance  actions  for  Navy  aviation.  Once  these 
linkages  are  established,  the  resulting  information  can 
be  used  to  support  resources  for  individual  training 
and  can  be  used  to  measure  effectiveness  of  training. 

•  Build  resource  models  for  examination  of  requirements  in 
support  of  workload  for  training.  Navy  data  is  readily 
available  in  NITRAS  to  support  this  effort.  It  would 
support  the  analytical  work  and  related  budgetary  impact 
for  OSD  and  the  TDAC . 

•  Develop  "pipelines"  for  Navy  maintenance  skills  similar 
to  the  example  developed  by  MCR.  These  pipelines  are 
needed  for  any  analyses  of  resources  for  maintenance  or 
non-maintenance  skills.  Also,  the  assessment  of  main¬ 
tenance  and  training  linkages  requires  this  same  infor¬ 
mation.  The  necessary  information  is  available  in  the 
NMPC  and  within  NITRAS. 
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AFSC 


AIMD 

AOB 

ARI 

ARPRINT 

ASVAB 

AT 

ATC 

ATRRS 

BB&E 

CANTRAC 

CHNAVPERS 

CMI 

CNAVRES 

CNET 

CNM 

CNO 

CNTECHTRA 

COMNAVCRU I TCOM 

COMTRALANT 

COMTRAPAC 

DS 

DSF 

EFNS 

FRAMP 

FTD 


Air  Force  Specialty  Code 

Aircraft  Intermediate  Maintenance  Detachment 

Average  on  Board 

Army  Research  Institute 

Army  Program  for  Individual  Training 

Armed  Services  Vocational  Aptitude  Battery 

Aviation  Electronics  Technician 

Air  Training  Command 

Army  Training  Requirements  and  Resources  System 

Basic  Electricity  and  Electronics 

Catalog  of  Navy  Training  Courses 

Chief  of  Naval  Personnel 

Computer  Managed  Instruction 

Chief  of  Naval  Reserves 

Chief  of  Naval  Education  and  Training 

Chief  of  Naval  Material 

Chief  of  Naval  Operations 

Chief  of  Naval  Technical  Training 

Commander  Naval  Recruiting  Command 

Commander  of  Training  Atlantic 

Commander  of  Training  Pacific 

Direct  Support 

Data  Services  Facility 

Enlisted  Force  Management  System 

Fleet  Replacement  Aviation  Maintenance  Program 

Field  Training  Detachment 

Grade  Adjusted  Recapitulation 


GAR 


JCN 


Job  Control  Number 


MAJCOM 

MDC 

NDR 

MDS 

MILPERCEN 

MMICS 

MMTR 

MOS 

MPS 

NAMSO 

NAVTRADET 

NAVTRAGRU 

NAS 

NATTC 

NAVAIR 

NEC 

NITRAS 


Major  Command 

Maintenance  Data  Collection  (System) 

Maintenance  Data  Report 

Maintenance  Data  System 

Military  Personnel  Center 

Maintenance  Management  Information  and 
Control  System 

Military  Manpower  Training  Report 
Military  Occupational  Specialty 
Maintenance  Performance  system 
Navy  Maintenance  Support  Office 
Naval  Air  Maintenance  Training  Detachment 
Naval  Air  Maintenance  Training  Group 
Naval  Air  Station 

Naval  Aviation  Technical  Training  Center 

Naval  Air  Systems  Command 

Navy  Enlisted  Classification 

Navy  Integrated  Training  Resources  and 
Administration  System 
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PMS 

PPBS 

PRIDE 

SAMS 

SPCC 

STRAFE 

TAMMS 

TDAC 

TIP 

TOP 

TQM 

TRADOC 

TTC 

UIC 

ULLS 

VIDS/MAF 

WUC 

3-M 


Pipeline  Management  System 

Planning  Programming  and  Budgeting  System 

Personalized  Recruiting  for  Immediate  and 
Delayed  Enlistment 

Standard  Army  Maintenance  System 

Ship  Parts  Control  Center  (Navy) 

Simulator  for  Total  Requirements 
Authorization  Forecast  Evaluation 

The  Army  Maintenance  Management  System 

Training  Data  and  Analysis  Center 

Training  Input  Plan 

Training  Output  Plan 

Training  Quota  Memorandum 

Training  and  Doctrine  Command 

Technical  Training  Center 

Unit  Identification  Code 

Unit  Level  Logistics  System 

Visual  Information  Display  System/Maintenance 
Action  Form 

Work  Unit  Code 

Maintenance  Material  Management 
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